-- Logs begin at Fri 2022-07-15 19:51:33 UTC, end at Fri 2022-07-15 20:56:56 UTC. -- Jul 15 20:27:58.585799 dv-cinder-799871-35-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 15 20:27:58.595341 dv-cinder-799871-35-iscsi devstack@n-api.service[103451]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 15 20:27:58.596813 dv-cinder-799871-35-iscsi devstack@n-api.service[103451]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jul 15 20:27:58 2022] *** Jul 15 20:27:58.596813 dv-cinder-799871-35-iscsi devstack@n-api.service[103451]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 15 20:27:58.596813 dv-cinder-799871-35-iscsi devstack@n-api.service[103451]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 15 20:27:58.596813 dv-cinder-799871-35-iscsi devstack@n-api.service[103451]: nodename: dv-cinder-799871-35-iscsi Jul 15 20:27:58.596813 dv-cinder-799871-35-iscsi devstack@n-api.service[103451]: machine: x86_64 Jul 15 20:27:58.596813 dv-cinder-799871-35-iscsi devstack@n-api.service[103451]: clock source: unix Jul 15 20:27:58.596813 dv-cinder-799871-35-iscsi devstack@n-api.service[103451]: pcre jit disabled Jul 15 20:27:58.596813 dv-cinder-799871-35-iscsi devstack@n-api.service[103451]: detected number of CPU cores: 4 Jul 15 20:27:58.596813 dv-cinder-799871-35-iscsi devstack@n-api.service[103451]: current working directory: / Jul 15 20:27:58.596813 dv-cinder-799871-35-iscsi devstack@n-api.service[103451]: detected binary path: /usr/bin/uwsgi-core Jul 15 20:27:58.598742 dv-cinder-799871-35-iscsi devstack@n-api.service[103451]: your processes number limit is 47680 Jul 15 20:27:58.598742 dv-cinder-799871-35-iscsi devstack@n-api.service[103451]: your memory page size is 4096 bytes Jul 15 20:27:58.598742 dv-cinder-799871-35-iscsi devstack@n-api.service[103451]: detected max file descriptor number: 2048 Jul 15 20:27:58.598742 dv-cinder-799871-35-iscsi devstack@n-api.service[103451]: lock engine: pthread robust mutexes Jul 15 20:27:58.598742 dv-cinder-799871-35-iscsi devstack@n-api.service[103451]: thunder lock: enabled Jul 15 20:27:58.598742 dv-cinder-799871-35-iscsi devstack@n-api.service[103451]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 15 20:27:58.598742 dv-cinder-799871-35-iscsi devstack@n-api.service[103451]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 15 20:27:58.637410 dv-cinder-799871-35-iscsi devstack@n-api.service[103451]: Python main interpreter initialized at 0x55976b0d89c0 Jul 15 20:27:58.637410 dv-cinder-799871-35-iscsi devstack@n-api.service[103451]: python threads support enabled Jul 15 20:27:58.637410 dv-cinder-799871-35-iscsi devstack@n-api.service[103451]: your server socket listen backlog is limited to 100 connections Jul 15 20:27:58.637410 dv-cinder-799871-35-iscsi devstack@n-api.service[103451]: your mercy for graceful operations on workers is 90 seconds Jul 15 20:27:58.637746 dv-cinder-799871-35-iscsi devstack@n-api.service[103451]: mapped 403077 bytes (393 KB) for 2 cores Jul 15 20:27:58.637822 dv-cinder-799871-35-iscsi devstack@n-api.service[103451]: *** Operational MODE: preforking *** Jul 15 20:27:58.638068 dv-cinder-799871-35-iscsi devstack@n-api.service[103451]: *** uWSGI is running in multiple interpreter mode *** Jul 15 20:27:58.638068 dv-cinder-799871-35-iscsi devstack@n-api.service[103451]: spawned uWSGI master process (pid: 103451) Jul 15 20:27:58.638261 dv-cinder-799871-35-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 15 20:27:58.639664 dv-cinder-799871-35-iscsi devstack@n-api.service[103451]: spawned uWSGI worker 1 (pid: 103452, cores: 1) Jul 15 20:27:58.639664 dv-cinder-799871-35-iscsi devstack@n-api.service[103451]: spawned uWSGI worker 2 (pid: 103453, cores: 1) Jul 15 20:27:58.639664 dv-cinder-799871-35-iscsi devstack@n-api.service[103451]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 15 20:27:59.297147 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 15 20:27:59.304787 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 15 20:28:00.410931 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 15 20:28:00.410931 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: from cryptography.utils import int_from_bytes Jul 15 20:28:00.411521 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 15 20:28:00.411521 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: from cryptography.utils import int_from_bytes Jul 15 20:28:00.416708 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 15 20:28:00.416708 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: from cryptography.utils import int_from_bytes Jul 15 20:28:00.417148 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 15 20:28:00.417148 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: from cryptography.utils import int_from_bytes Jul 15 20:28:02.934979 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 15 20:28:02.935624 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 15 20:28:02.935732 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 15 20:28:02.935732 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 15 20:28:02.936118 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 15 20:28:02.936118 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 15 20:28:02.936247 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 15 20:28:02.936322 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 15 20:28:02.936630 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 15 20:28:02.936743 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.936890 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 15 20:28:02.937037 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.937274 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.937369 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.937599 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.937694 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.937920 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.938011 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.938240 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.938334 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.938565 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.938655 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.938873 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.938962 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.939192 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.939277 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.939448 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.939530 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.939761 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.939858 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.940080 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.940170 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-799871-35-iscsi {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.940412 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.940498 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.940721 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.940912 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-799871-35-iscsi {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.941032 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.941168 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.941342 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.941431 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.941641 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.941745 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.941958 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.942045 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.942262 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.942356 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.942584 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.942804 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.942915 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.943251 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.943404 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.943575 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.943674 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.943860 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.943962 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.944195 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.944297 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.944529 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.944624 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.944837 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.944936 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.945155 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.945244 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.945460 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.945554 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.945779 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.945879 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.946091 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.946204 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.946396 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.946482 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-799871-35-iscsi {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.946781 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.946868 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-799871-35-iscsi {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.947094 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.947179 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.947405 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.947490 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.947718 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.947805 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.948111 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.948204 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.948440 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.949319 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.949526 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.949608 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.949686 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.949814 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.949910 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.950158 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.950254 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.950469 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.950563 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.950801 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.950889 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.951125 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.951263 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.951442 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.951527 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.951752 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.951853 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.952053 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.952138 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.952364 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.952526 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.952689 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.952775 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.952993 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.953079 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.953244 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.953339 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.953548 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.953635 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.953835 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.953919 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.954140 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.954246 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.954464 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.954553 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.954748 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.954876 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.954997 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.955087 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.955313 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.955409 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.955569 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.955656 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.955887 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.955982 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.956208 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.956295 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.956534 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.956640 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.956840 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.956925 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.957142 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.957233 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.957448 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.957547 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.957748 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.957835 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.958051 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.958142 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.958356 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.958451 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.958662 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.958749 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.958976 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.959060 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.959282 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.959380 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.959596 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.959682 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.959901 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.959987 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.66 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.960222 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.960317 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.66 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.960547 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.960726 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.66 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.960883 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.960969 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.66 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.961199 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.961333 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.961502 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.961588 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.961818 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.961906 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.962136 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.962230 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.962441 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.962534 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.962743 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.962838 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.963046 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.963141 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.963364 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.963451 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.963671 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.963768 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.963981 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.964074 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.964349 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.964574 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.964787 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.964890 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.964973 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.965059 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.965148 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.965319 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.965456 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.965623 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.965759 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.965942 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.966062 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.966249 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.966358 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.966555 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.966650 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.966860 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.966960 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.967160 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.967326 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.967466 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.967552 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.967770 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.967857 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.968076 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.968180 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.968382 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.968489 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.968706 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.968792 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.969006 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.969104 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.969312 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.969405 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.969621 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.969707 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.969921 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.970020 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.970225 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.970312 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.970525 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.970627 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.970825 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.970924 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.971128 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.971214 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.971431 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.971526 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.971731 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.971826 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.972046 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.972130 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.972343 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.972472 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.972667 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.972774 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.972981 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.973084 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.973283 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.973368 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.973584 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.973681 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.973900 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.973986 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.974195 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.974281 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.974498 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.974631 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.974809 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.974894 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.975106 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.975199 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.975405 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.975499 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.975704 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.975790 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.976001 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.976088 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.976299 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.976447 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.976623 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.976711 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.976922 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.977015 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.977221 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.977307 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.977518 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.977603 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.977817 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.977910 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.978120 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.978207 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.978420 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.978520 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.978720 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.978813 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.979019 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.979105 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.979332 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.979417 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.979643 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.979738 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.980022 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.980227 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.980318 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:28:02.980437 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.980676 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.980782 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.981010 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.981097 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.981353 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.981446 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.981671 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.981762 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.981979 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.982070 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.982289 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.982376 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.982613 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.982710 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.982920 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.983004 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.983224 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.983308 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.983531 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.983629 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.983842 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.983927 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.984150 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.984250 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.984481 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.984574 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.984801 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.984905 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.985117 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.985211 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.985433 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.985566 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.985741 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.985829 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.986054 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.986140 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.986372 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.986494 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.986680 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.986767 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.986987 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.987081 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.987314 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.987406 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.987631 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.987725 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.987941 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.988116 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.988262 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.988348 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.988603 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.988690 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.988912 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.989012 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.989218 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.989305 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.989522 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.989621 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.989838 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.989933 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.990144 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.990230 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.990452 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.990537 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.990759 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.990858 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.991066 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.991153 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.991370 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.991456 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.991675 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.991762 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.991980 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.992064 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.992283 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.992375 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.992615 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.992704 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.992925 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.993010 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.993236 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.993330 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.993542 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.993636 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.993854 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.993948 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.994160 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.994259 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.994468 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.994553 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.994771 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.994870 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.995070 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.995166 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.995371 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.996043 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.996194 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.996281 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.996520 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.996658 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.996820 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.996913 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.997121 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.997260 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.997428 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.997528 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.997732 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.997818 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.998051 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.998137 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.998349 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.998444 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.998654 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.998741 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.998958 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.999043 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.999262 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.999357 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.999563 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.999650 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.999869 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:02.999954 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.000170 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.000256 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.000496 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.000584 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.000811 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.000897 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.001114 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.001200 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.001413 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.001499 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.001734 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.001820 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.002036 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.002123 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.002335 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.002429 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.002644 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.002744 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.002947 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.003033 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.003251 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.003335 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.003559 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.003654 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.003864 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.003950 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.004171 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.004256 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.004502 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.004605 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.004812 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.004944 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.005134 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.005227 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.005447 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.005535 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.005747 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.005833 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.006069 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.006205 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.006391 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.006479 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.006695 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.006829 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.006992 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.007077 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.007293 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.007381 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.007593 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.007680 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.007891 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.007988 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.008189 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.008277 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.008518 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.008605 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.008817 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.008924 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.009114 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.009209 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.009410 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.009498 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.009709 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.009807 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.010005 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.010095 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.010308 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.010393 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.010611 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.010711 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.010906 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.010991 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.011755 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.011884 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.012071 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.012173 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.012376 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.012520 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.012704 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.012821 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.013006 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.013162 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.013349 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.013481 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.013652 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.013797 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.013993 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.014117 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.014331 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.014426 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.014651 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.014738 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.014975 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.015062 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.015287 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.015382 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.015600 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.015692 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.015906 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.016002 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.016214 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.016299 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.016544 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.016644 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.016855 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.016947 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.017159 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.017244 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.017469 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.017632 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.017781 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.017866 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.018088 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.018172 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.018386 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.018482 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.018697 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.018784 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.019015 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.019110 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.019319 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.019417 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.019633 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.019717 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.019954 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.020051 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.020258 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.020527 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.020619 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.020699 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.020886 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.020980 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.021192 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.021280 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.021497 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.021584 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.021804 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.021890 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.022117 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.022206 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.022424 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.022516 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.022736 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.022823 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.023037 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.023132 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.023352 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.023437 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.023654 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.023739 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.023963 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.024048 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.024259 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.024343 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.024594 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.024682 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.024911 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.025006 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.025215 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.025314 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.025528 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.025628 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.025834 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.025930 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.026153 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.026240 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.026461 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.026564 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.026791 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.026881 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.027113 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.027202 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.027483 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.027579 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.027785 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.027873 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.028089 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.028175 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.028417 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.028518 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.028726 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.028819 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.029033 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.029126 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.029332 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.029420 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.029640 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.029726 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.029945 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.030040 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.030246 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.030334 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.030544 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.030631 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.030851 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.030936 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.031155 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.031249 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.031458 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.031544 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.031768 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.031854 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.032087 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.032174 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.032409 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.032498 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.032714 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.032810 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.033032 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.033118 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.033334 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.033426 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.033631 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.033729 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.033930 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.034018 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.034230 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.034316 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.034532 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.034626 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.034837 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.034923 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.035139 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.035226 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.035448 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.035542 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.035780 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.035925 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.036065 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.036150 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.036371 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.036528 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.036699 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.036786 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.037003 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.037342 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.037565 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.037659 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.037873 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.037960 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.038174 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.038258 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.038480 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.038568 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.038786 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.038872 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.039091 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.039220 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.039396 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.039490 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.039706 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.039791 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.040008 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.040101 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.040312 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.040421 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.040644 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.040741 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.040944 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.041040 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.041249 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.041346 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.041556 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.041651 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.041861 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.042116 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.042255 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.042484 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.042574 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.042799 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.043114 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.043213 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.043430 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.043517 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.043744 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.043838 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.044073 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.044167 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.044432 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.044523 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.044743 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.044828 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.045045 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.045208 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.045352 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.045441 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.045655 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.045741 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.045956 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.046058 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.046261 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.046358 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.046561 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.046648 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.046859 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.046946 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.047160 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.047248 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.047469 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.047556 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.047769 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.047865 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.048067 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.048162 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.048365 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.048481 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.048690 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.048778 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.048995 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.049082 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.049294 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.049387 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.049597 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.049690 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.049893 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.049989 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.050212 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.050297 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.050513 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.050600 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.050811 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.050905 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.051109 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.051196 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.051405 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.051500 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.051715 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.051801 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.052020 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.052108 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.052324 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.052493 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.052689 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.052775 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.052992 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.053078 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.053314 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.053408 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.053613 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.053699 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.053931 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.054025 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.054231 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.054319 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.054529 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.054617 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.054827 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.054913 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.055129 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.055218 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.055429 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.055523 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.055725 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.055811 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.056030 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.056125 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.056333 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.056437 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.056662 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.056747 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.056965 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.057053 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.057266 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.057352 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.057570 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.057666 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.057866 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.058488 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.058694 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.058787 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.059017 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.059119 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.059379 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.059465 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.059679 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.059765 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.059984 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.060081 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.060288 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.060376 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.060612 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.060699 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.060918 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.061017 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.061215 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.061309 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.061519 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.061630 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.061816 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.061938 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.062119 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.062371 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.062470 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.062677 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.062775 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.062984 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.063070 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.063289 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.063375 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.063589 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.063686 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.063892 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.063977 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.064194 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.064282 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.064522 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.064629 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.064827 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.064915 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.065133 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.065227 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.065432 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.065519 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.065731 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.065825 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.066031 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.066118 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.066333 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.066421 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.066642 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.066730 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.066942 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.067033 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.067247 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.067335 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.067545 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.067632 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.067852 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.067937 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.068151 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.068237 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.068476 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.068563 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.068780 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.068879 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.069082 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.069168 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.069381 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.069516 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.069679 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.069775 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.069978 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.070065 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.070287 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.070380 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.070589 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.070752 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.070914 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.071000 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.071248 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.071366 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.071554 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.071674 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.071860 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.072019 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.072162 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.072324 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.072528 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.072707 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.072832 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.073013 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.073194 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.073326 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.073503 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.073927 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.074017 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.074106 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.074187 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.074291 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.074495 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.074605 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.074807 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.074894 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.075121 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.075215 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.075426 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.075523 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.075741 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.075836 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.076052 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.076153 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.076365 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.076474 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.076693 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.076779 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.076999 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.077102 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.077304 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.077389 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.077616 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.077701 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.077929 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.078025 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.078248 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.078334 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.078548 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.078634 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.078853 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.078948 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.079159 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.079246 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.079462 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.079586 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.079766 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.079863 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.080074 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.080166 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.080379 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.080514 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.080707 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.080798 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.081015 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.081109 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.081325 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.081410 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.081630 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.081716 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.081932 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.082019 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.082236 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.082330 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.082540 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.082626 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.082838 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.082923 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.083145 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.083230 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.083452 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.083541 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.083749 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.083833 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.084053 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.084148 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.084354 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.084500 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.084684 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.084769 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.084984 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.085082 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.085291 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.085409 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.085595 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.085716 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.086022 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.086122 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.086320 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.086405 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.086626 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.086713 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.086974 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.087084 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.087231 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.087318 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.087540 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.087628 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.087840 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.087987 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.088155 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.088241 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.088480 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.088600 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.088900 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.088990 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.089716 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.089855 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.090021 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.090108 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.090320 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.090408 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.090624 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.090712 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.090944 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.091039 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.091246 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.091333 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.091544 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.091631 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.091844 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.091940 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.092162 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.092250 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.092488 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.092582 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.092805 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.092907 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.093106 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.093222 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.093428 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.093514 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.093823 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.093919 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.094144 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.094229 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.094448 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.094536 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.094824 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.094926 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.095142 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.095229 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.095451 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.095546 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.095768 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.095854 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.096066 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.096154 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.096375 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.096622 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.096720 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.096802 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.097021 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.097154 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.097314 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.097405 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.097623 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.097708 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.097938 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.098062 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.098240 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.098334 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.098550 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.098636 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.098857 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.098945 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.099163 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.099250 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.099481 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.099569 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.099792 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.099914 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.100113 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.100200 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.100523 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.100631 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.100842 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.100930 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.101165 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.101250 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.101463 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.101557 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.101762 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.101849 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.102067 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.102156 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.102368 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.102464 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.102667 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.102754 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.102968 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.103053 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.103273 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.103377 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.103578 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.103664 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.103882 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.103969 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.104185 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.104281 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.104511 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.104600 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.105466 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.105575 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.105669 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.105786 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.105953 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.106096 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.106272 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.106424 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.106582 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.106730 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.106898 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.107054 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.107213 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.107367 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.107513 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.107692 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.107831 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.108011 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.108138 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.108313 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.108457 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.108661 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.108751 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.108969 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.109057 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.109271 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.109366 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.109573 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.109662 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.109875 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.110004 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.110215 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.110305 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.110523 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.110618 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.110844 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.110932 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.111176 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.111265 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.111498 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.111585 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.111808 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.111912 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.112116 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.112203 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.112453 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.112544 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.112757 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.112856 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.113057 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.113147 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.113361 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.113448 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.113660 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.113757 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.113960 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.114049 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.114259 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.114346 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.114561 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.114661 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.114861 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.114949 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.115161 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.115248 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.115461 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.115549 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.115764 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.115859 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.116065 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.116152 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.116366 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.116470 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.116695 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.116781 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.116994 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.117082 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.117296 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.117384 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.117593 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.117681 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.117907 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.117992 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.118213 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.118301 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.118516 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.118602 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.118836 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.118931 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.119147 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.119233 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.119470 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.119555 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.119776 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.119913 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.120097 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.120185 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.120481 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.120587 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.120775 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.120872 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.121094 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.121198 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.121403 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.121494 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.121713 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.121811 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.122026 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.122120 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.122336 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.122430 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.122642 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.122731 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.122954 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.123080 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.123266 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.123364 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.123573 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.123660 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.123889 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.124085 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.124205 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.124434 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.124537 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.124752 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.125053 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.125140 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.125359 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.125446 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.125670 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.125765 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.125981 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.126067 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.126288 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.126386 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.126595 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.126683 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.126900 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.126994 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.127207 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.127303 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.127516 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.127611 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.127825 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.127914 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.128136 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.128232 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.128488 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.128581 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.128801 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.128886 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.129111 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.129200 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.129420 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.129507 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.129729 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.129817 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.130046 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.130133 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.130360 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.130447 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.130672 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.130767 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.130983 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.131072 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.131295 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.131381 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.131606 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.131707 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.131914 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.132009 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.132222 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.132316 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.132554 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.132643 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.132863 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.132949 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.133171 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.133256 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.133474 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.133570 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.133783 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.133871 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.134089 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.134175 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.134396 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.134483 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.134710 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.134797 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.135024 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.135120 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.135333 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.135418 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.135643 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.135738 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.135955 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.136094 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.136294 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.136547 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.136638 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.136933 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.137032 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.137269 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.137448 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.137584 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.137761 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.137914 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.138090 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.138230 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.138415 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.138544 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.138738 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.138870 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.139051 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.139175 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.139366 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.139480 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.139691 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.139778 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.139996 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.140086 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.140298 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.140386 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.140636 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.140723 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.140944 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.141041 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.141247 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.141334 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.141566 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.141661 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.141873 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.141960 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.142174 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.142400 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.142495 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.142741 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.142836 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.143054 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.143306 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.143393 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.143656 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.143753 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.143977 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.144065 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.144284 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.144370 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.144633 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.144735 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.144939 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.145028 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.145242 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.145337 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.145556 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.145652 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.145863 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.145959 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.146164 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.146249 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.146467 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.146564 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.146776 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.146870 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.147080 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.147166 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.147382 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.147470 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.147686 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.147772 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.147991 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.148077 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.148294 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.148383 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.148628 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.148726 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.148930 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.149025 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.149228 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.149314 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.149537 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.149623 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.149840 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.149935 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.150138 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.150223 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.150440 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.150534 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.150740 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.150836 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.151042 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.151129 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.151341 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.151434 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.151643 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.152289 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.152608 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.152702 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.152927 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.153014 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.153235 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.153331 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.153543 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.153640 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.153855 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.153949 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.154162 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.154251 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.154473 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.154568 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.154782 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.154868 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.155096 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.155184 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.155403 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.155490 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.155720 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.155806 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.156024 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.156111 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.156331 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.156433 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.156683 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.156778 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.156997 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.157086 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.157310 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.157523 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.157659 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.157859 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.157959 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.158176 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.158495 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.158583 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.158827 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.158926 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.159134 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.159222 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.159437 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.159525 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.159741 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.159842 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.160063 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.160151 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.160368 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.160491 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.160702 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.160798 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.161010 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.161097 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.161319 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.161406 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.161625 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.161715 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.161932 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.162027 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.162493 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.162581 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.162800 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.162888 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.163104 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.163197 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.163411 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.163545 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.163716 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.163803 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.164022 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.164108 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.164325 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.164443 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.164662 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.164750 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.164967 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.165053 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.165276 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.165374 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.165593 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.165681 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.165905 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.165999 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.166220 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.166321 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.166529 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.166629 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.166837 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.166926 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.167144 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.167232 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.168002 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.168106 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.168327 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.168520 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.168685 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.168817 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.169000 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.169111 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.169302 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.169434 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.169717 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.169813 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.170028 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.170123 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.170347 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.170509 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.170669 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.170790 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.170975 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.171107 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.171296 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.171429 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.171616 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.171754 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.171924 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.172065 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.172244 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.172404 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.172578 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.172737 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.172907 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.173051 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.173245 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.173377 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.173575 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.173693 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.173898 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.174026 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.174202 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.174367 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.174507 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.174702 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.174797 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.175030 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.175126 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.175337 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.175424 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.175644 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.175733 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.175951 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.176040 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.176261 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.176348 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.176597 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.176686 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.176901 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.176999 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.177203 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.177291 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.177503 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.177597 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.177807 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.177895 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.178109 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.178195 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.178412 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.178544 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.178712 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.178800 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.179011 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.179099 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.179312 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.179412 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.179610 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.179696 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.179908 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.180001 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.180209 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.180304 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.180529 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.180619 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.180832 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.180917 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.181129 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.181228 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.181430 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.181517 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.181727 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.181822 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.182031 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.182131 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.182333 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.182421 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.182638 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.182725 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.182961 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.183058 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.183299 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.183394 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.183632 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.183726 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.183950 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.184039 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.184275 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.184364 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.184617 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.184706 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.184939 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.185071 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.185249 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.185341 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.185578 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.185665 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.185886 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.185974 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.186200 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.186297 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.186512 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.186612 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.186818 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.186959 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.187125 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.187217 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.187436 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.187534 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.187747 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.187832 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.188055 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.188150 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.188364 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.188536 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.188700 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.188792 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.189021 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.189115 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.189341 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.189430 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.189646 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.189741 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.189956 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.190043 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.190281 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.190369 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.190589 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.190675 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.190901 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.190988 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.191208 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.191295 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.191515 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.191602 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.191826 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.191923 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.192137 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.192224 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.192469 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.192562 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.192780 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.192885 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.193089 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.193184 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.193399 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.193485 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.193707 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.193802 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.194017 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.194106 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.194328 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.194415 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.194642 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.194729 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.194963 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.195056 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.195289 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.195376 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.195600 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.195688 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.195923 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.196009 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.196251 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.196347 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.196586 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.196675 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.196896 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.196983 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.197199 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.197296 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.197441 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 15 20:28:03.197581 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.197896 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.198208 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.198514 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:28:03.198882 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 15 20:28:03.259344 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: INFO dbcounter [None req-dc5bc4a9-682c-4221-9a38-fd5ff896bd76 None None] Registered counter for database nova_api Jul 15 20:28:03.260625 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: INFO dbcounter [None req-47055382-97d5-4c52-9d51-89230ea857d1 None None] Registered counter for database nova_api Jul 15 20:28:03.373158 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG oslo_db.sqlalchemy.engines [None req-dc5bc4a9-682c-4221-9a38-fd5ff896bd76 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 20:28:03.374815 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG oslo_db.sqlalchemy.engines [None req-47055382-97d5-4c52-9d51-89230ea857d1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103452) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 20:28:03.379735 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG dbcounter [-] [103453] Writer thread running {{(pid=103453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 20:28:03.381140 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG dbcounter [-] [103452] Writer thread running {{(pid=103452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 20:28:03.436495 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.context [None req-dc5bc4a9-682c-4221-9a38-fd5ff896bd76 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5eaba057-d4d0-4606-828e-5e21cf3c2999(cell1) {{(pid=103453) load_cells /opt/stack/nova/nova/context.py:464}} Jul 15 20:28:03.438030 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.context [None req-47055382-97d5-4c52-9d51-89230ea857d1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5eaba057-d4d0-4606-828e-5e21cf3c2999(cell1) {{(pid=103452) load_cells /opt/stack/nova/nova/context.py:464}} Jul 15 20:28:03.440343 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG oslo_concurrency.lockutils [None req-dc5bc4a9-682c-4221-9a38-fd5ff896bd76 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:28:03.441913 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG oslo_concurrency.lockutils [None req-dc5bc4a9-682c-4221-9a38-fd5ff896bd76 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:28:03.442041 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG oslo_concurrency.lockutils [None req-47055382-97d5-4c52-9d51-89230ea857d1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:28:03.442709 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG oslo_concurrency.lockutils [None req-dc5bc4a9-682c-4221-9a38-fd5ff896bd76 None None] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:28:03.443512 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG oslo_concurrency.lockutils [None req-47055382-97d5-4c52-9d51-89230ea857d1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:28:03.444316 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG oslo_concurrency.lockutils [None req-47055382-97d5-4c52-9d51-89230ea857d1 None None] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:28:03.444840 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG oslo_concurrency.lockutils [None req-dc5bc4a9-682c-4221-9a38-fd5ff896bd76 None None] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:28:03.446434 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG oslo_concurrency.lockutils [None req-47055382-97d5-4c52-9d51-89230ea857d1 None None] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:28:03.446809 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: INFO dbcounter [None req-dc5bc4a9-682c-4221-9a38-fd5ff896bd76 None None] Registered counter for database nova_cell0 Jul 15 20:28:03.448451 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: INFO dbcounter [None req-47055382-97d5-4c52-9d51-89230ea857d1 None None] Registered counter for database nova_cell0 Jul 15 20:28:03.451275 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: INFO dbcounter [None req-dc5bc4a9-682c-4221-9a38-fd5ff896bd76 None None] Registered counter for database nova_cell1 Jul 15 20:28:03.452918 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: INFO dbcounter [None req-47055382-97d5-4c52-9d51-89230ea857d1 None None] Registered counter for database nova_cell1 Jul 15 20:28:03.458722 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG oslo_db.sqlalchemy.engines [None req-dc5bc4a9-682c-4221-9a38-fd5ff896bd76 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 20:28:03.460048 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG oslo_db.sqlalchemy.engines [None req-47055382-97d5-4c52-9d51-89230ea857d1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103452) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 20:28:03.461520 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG oslo_db.sqlalchemy.engines [None req-dc5bc4a9-682c-4221-9a38-fd5ff896bd76 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 20:28:03.465620 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG dbcounter [-] [103452] Writer thread running {{(pid=103452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 20:28:03.466283 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG oslo_db.sqlalchemy.engines [None req-47055382-97d5-4c52-9d51-89230ea857d1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103452) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 20:28:03.469619 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG dbcounter [-] [103453] Writer thread running {{(pid=103453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 20:28:03.469955 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG dbcounter [-] [103453] Writer thread running {{(pid=103453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 20:28:03.610791 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG dbcounter [-] [103452] Writer thread running {{(pid=103452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 20:28:03.613561 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: INFO dbcounter [None req-dc5bc4a9-682c-4221-9a38-fd5ff896bd76 None None] Registered counter for database nova_cell0 Jul 15 20:28:03.619645 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: INFO dbcounter [None req-47055382-97d5-4c52-9d51-89230ea857d1 None None] Registered counter for database nova_cell0 Jul 15 20:28:03.620264 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG oslo_db.sqlalchemy.engines [None req-dc5bc4a9-682c-4221-9a38-fd5ff896bd76 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 20:28:03.625383 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG dbcounter [-] [103453] Writer thread running {{(pid=103453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 20:28:03.628833 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG oslo_db.sqlalchemy.engines [None req-47055382-97d5-4c52-9d51-89230ea857d1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103452) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 20:28:03.633133 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG dbcounter [-] [103452] Writer thread running {{(pid=103452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 20:28:03.962361 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: WARNING keystonemiddleware.auth_token [None req-dc5bc4a9-682c-4221-9a38-fd5ff896bd76 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 15 20:28:03.969743 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: WARNING keystonemiddleware.auth_token [None req-dc5bc4a9-682c-4221-9a38-fd5ff896bd76 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 15 20:28:03.974062 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: WARNING keystonemiddleware.auth_token [None req-47055382-97d5-4c52-9d51-89230ea857d1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 15 20:28:03.981941 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: WARNING keystonemiddleware.auth_token [None req-47055382-97d5-4c52-9d51-89230ea857d1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 15 20:28:04.311000 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: WARNING keystonemiddleware.auth_token [None req-dc5bc4a9-682c-4221-9a38-fd5ff896bd76 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 15 20:28:04.316833 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: WARNING keystonemiddleware.auth_token [None req-dc5bc4a9-682c-4221-9a38-fd5ff896bd76 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 15 20:28:04.322066 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55976b0d89c0 pid: 103453 (default app) Jul 15 20:28:04.324334 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi [None req-dc5bc4a9-682c-4221-9a38-fd5ff896bd76 None None] Calling method '>' {{(pid=103453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:28:04.325526 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: INFO nova.api.openstack.requestlog [None req-dc5bc4a9-682c-4221-9a38-fd5ff896bd76 None None] 10.222.0.66 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001947 Jul 15 20:28:04.325932 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: [pid: 103453|app: 0|req: 1/1] 10.222.0.66 () {50 vars in 788 bytes} [Fri Jul 15 20:28:04 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:28:04.332258 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: WARNING keystonemiddleware.auth_token [None req-47055382-97d5-4c52-9d51-89230ea857d1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 15 20:28:04.338208 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: WARNING keystonemiddleware.auth_token [None req-47055382-97d5-4c52-9d51-89230ea857d1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 15 20:28:04.344040 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55976b0d89c0 pid: 103452 (default app) Jul 15 20:29:20.446925 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi [None req-dc5bc4a9-682c-4221-9a38-fd5ff896bd76 None None] Calling method '>' {{(pid=103453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:29:20.447933 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: INFO nova.api.openstack.requestlog [None req-dc5bc4a9-682c-4221-9a38-fd5ff896bd76 None None] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Jul 15 20:29:20.448714 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: [pid: 103453|app: 0|req: 2/2] 10.222.0.66 () {54 vars in 930 bytes} [Fri Jul 15 20:29:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:29:20.461545 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG dbcounter [-] [103452] Writing DB stats nova_api:SELECT=3 {{(pid=103452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:29:20.462711 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG dbcounter [-] [103452] Writing DB stats nova_cell0:SELECT=3 {{(pid=103452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:29:20.463524 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG dbcounter [-] [103452] Writing DB stats nova_cell1:SELECT=3 {{(pid=103452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:29:20.465311 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG dbcounter [-] [103452] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:29:21.334760 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi [None req-cbae0c74-aaa7-45fb-8232-890f571f5fb5 admin admin] Calling method '>' {{(pid=103452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:29:21.365592 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: INFO nova.api.openstack.requestlog [None req-cbae0c74-aaa7-45fb-8232-890f571f5fb5 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.910036 Jul 15 20:29:21.366500 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: [pid: 103452|app: 0|req: 1/3] 10.222.0.66 () {60 vars in 1291 bytes} [Fri Jul 15 20:29:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:29:23.603616 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi [None req-dc5bc4a9-682c-4221-9a38-fd5ff896bd76 None None] Calling method '>' {{(pid=103453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:29:23.605243 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: INFO nova.api.openstack.requestlog [None req-dc5bc4a9-682c-4221-9a38-fd5ff896bd76 None None] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Jul 15 20:29:23.606335 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: [pid: 103453|app: 0|req: 3/4] 10.222.0.66 () {54 vars in 930 bytes} [Fri Jul 15 20:29:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:29:24.057194 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi [None req-b38e978f-5132-473d-85d5-680393978a3b admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "id": "c1", "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 1}} {{(pid=103452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:29:24.076052 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 15 20:29:24.076052 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: warnings.warn(msg) Jul 15 20:29:24.107733 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: INFO nova.api.openstack.requestlog [None req-b38e978f-5132-473d-85d5-680393978a3b admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.495511 Jul 15 20:29:24.108301 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: [pid: 103452|app: 0|req: 2/5] 10.222.0.66 () {64 vars in 1282 bytes} [Fri Jul 15 20:29:23 2022] POST /compute/v2.1/flavors => generated 407 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 15 20:29:24.329256 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi [None req-2456a1ed-0083-4855-88c6-54bc042035ec admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:29:24.331733 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 15 20:29:24.331733 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: warnings.warn(msg) Jul 15 20:29:24.352483 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG dbcounter [-] [103453] Writing DB stats nova_api:SELECT=3 {{(pid=103453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:29:24.353460 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG dbcounter [-] [103453] Writing DB stats nova_cell0:SELECT=3 {{(pid=103453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:29:24.354252 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG dbcounter [-] [103453] Writing DB stats nova_cell1:SELECT=3 {{(pid=103453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:29:24.355588 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG dbcounter [-] [103453] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:29:24.403916 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: INFO nova.api.openstack.requestlog [None req-2456a1ed-0083-4855-88c6-54bc042035ec admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.287081 Jul 15 20:29:24.404825 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: [pid: 103453|app: 0|req: 4/6] 10.222.0.66 () {64 vars in 1335 bytes} [Fri Jul 15 20:29:24 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:29:26.637929 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi [None req-b38e978f-5132-473d-85d5-680393978a3b admin admin] Calling method '>' {{(pid=103452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:29:26.639771 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: INFO nova.api.openstack.requestlog [None req-b38e978f-5132-473d-85d5-680393978a3b admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002197 Jul 15 20:29:26.640285 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: [pid: 103452|app: 0|req: 3/7] 10.222.0.66 () {54 vars in 930 bytes} [Fri Jul 15 20:29:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:29:27.298986 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi [None req-b3eea17e-8702-4483-9f0c-3a907099ad3d admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "name": "ds512M", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d1", "swap": 0}} {{(pid=103453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:29:27.317443 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 15 20:29:27.317443 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: warnings.warn(msg) Jul 15 20:29:27.339229 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: INFO nova.api.openstack.requestlog [None req-b3eea17e-8702-4483-9f0c-3a907099ad3d admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.692802 Jul 15 20:29:27.346895 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: [pid: 103453|app: 0|req: 5/8] 10.222.0.66 () {64 vars in 1282 bytes} [Fri Jul 15 20:29:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 20:29:27.352439 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi [None req-ca6403b7-da85-481f-9954-96888f3a3a70 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:29:27.354146 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 15 20:29:27.354146 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: warnings.warn(msg) Jul 15 20:29:27.387804 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: INFO nova.api.openstack.requestlog [None req-ca6403b7-da85-481f-9954-96888f3a3a70 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039139 Jul 15 20:29:27.396627 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: [pid: 103452|app: 0|req: 4/9] 10.222.0.66 () {64 vars in 1335 bytes} [Fri Jul 15 20:29:27 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:29:29.631954 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi [None req-b3eea17e-8702-4483-9f0c-3a907099ad3d admin admin] Calling method '>' {{(pid=103453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:29:29.633099 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: INFO nova.api.openstack.requestlog [None req-b3eea17e-8702-4483-9f0c-3a907099ad3d admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001544 Jul 15 20:29:29.633562 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: [pid: 103453|app: 0|req: 6/10] 10.222.0.66 () {54 vars in 930 bytes} [Fri Jul 15 20:29:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:29:30.033132 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi [None req-8a46a1f1-da10-49ba-b33d-a6c5794de38d admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "vcpus": 1, "id": "d2", "os-flavor-access:is_public": true, "disk": 10, "name": "ds1G", "rxtx_factor": 1.0}} {{(pid=103452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:29:30.050716 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: INFO nova.api.openstack.requestlog [None req-8a46a1f1-da10-49ba-b33d-a6c5794de38d admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.410943 Jul 15 20:29:30.051354 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: [pid: 103452|app: 0|req: 5/11] 10.222.0.66 () {64 vars in 1282 bytes} [Fri Jul 15 20:29:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 15 20:29:30.063263 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi [None req-8575e8e7-4cb8-4e34-a084-8b142eb9e442 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:29:30.085796 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: INFO nova.api.openstack.requestlog [None req-8575e8e7-4cb8-4e34-a084-8b142eb9e442 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026183 Jul 15 20:29:30.086342 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: [pid: 103453|app: 0|req: 7/12] 10.222.0.66 () {64 vars in 1335 bytes} [Fri Jul 15 20:29:30 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:29:32.277523 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi [None req-8a46a1f1-da10-49ba-b33d-a6c5794de38d admin admin] Calling method '>' {{(pid=103452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:29:32.278607 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: INFO nova.api.openstack.requestlog [None req-8a46a1f1-da10-49ba-b33d-a6c5794de38d admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 Jul 15 20:29:32.279038 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: [pid: 103452|app: 0|req: 6/13] 10.222.0.66 () {54 vars in 930 bytes} [Fri Jul 15 20:29:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:29:32.718313 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi [None req-47923530-bd32-4b46-89a4-f7690f0ad37b admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 2048, "vcpus": 2, "rxtx_factor": 1.0, "disk": 10, "id": "d3", "name": "ds2G", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:29:32.738619 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: INFO nova.api.openstack.requestlog [None req-47923530-bd32-4b46-89a4-f7690f0ad37b admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.451304 Jul 15 20:29:32.739171 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: [pid: 103453|app: 0|req: 8/14] 10.222.0.66 () {64 vars in 1282 bytes} [Fri Jul 15 20:29:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 15 20:29:32.752293 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi [None req-ed582b3f-e222-42dd-889c-c7ed34e366af admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:29:32.793466 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: INFO nova.api.openstack.requestlog [None req-ed582b3f-e222-42dd-889c-c7ed34e366af admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044862 Jul 15 20:29:32.796516 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: [pid: 103452|app: 0|req: 7/15] 10.222.0.66 () {64 vars in 1335 bytes} [Fri Jul 15 20:29:32 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:29:35.045704 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi [None req-47923530-bd32-4b46-89a4-f7690f0ad37b admin admin] Calling method '>' {{(pid=103453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:29:35.046715 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: INFO nova.api.openstack.requestlog [None req-47923530-bd32-4b46-89a4-f7690f0ad37b admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jul 15 20:29:35.047114 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: [pid: 103453|app: 0|req: 9/16] 10.222.0.66 () {54 vars in 930 bytes} [Fri Jul 15 20:29:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:29:35.489453 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi [None req-f8b6439c-6078-41e1-91ff-0709d578ecaf admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "swap": 0, "vcpus": 4, "rxtx_factor": 1.0, "id": "d4", "name": "ds4G", "os-flavor-access:is_public": true}} {{(pid=103452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:29:35.509498 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: INFO nova.api.openstack.requestlog [None req-f8b6439c-6078-41e1-91ff-0709d578ecaf admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.456473 Jul 15 20:29:35.510153 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: [pid: 103452|app: 0|req: 8/17] 10.222.0.66 () {64 vars in 1282 bytes} [Fri Jul 15 20:29:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 20:29:35.522585 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi [None req-d4f424c7-5c6f-486b-8d2d-0bd0321203cd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:29:35.547032 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: INFO nova.api.openstack.requestlog [None req-d4f424c7-5c6f-486b-8d2d-0bd0321203cd admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028022 Jul 15 20:29:35.547598 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: [pid: 103453|app: 0|req: 10/18] 10.222.0.66 () {64 vars in 1335 bytes} [Fri Jul 15 20:29:35 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:29:37.855926 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi [None req-f8b6439c-6078-41e1-91ff-0709d578ecaf admin admin] Calling method '>' {{(pid=103452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:29:37.857125 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: INFO nova.api.openstack.requestlog [None req-f8b6439c-6078-41e1-91ff-0709d578ecaf admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001773 Jul 15 20:29:37.857526 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: [pid: 103452|app: 0|req: 9/19] 10.222.0.66 () {54 vars in 930 bytes} [Fri Jul 15 20:29:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 20:29:38.387979 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi [None req-a5451e7d-1fd5-43e4-8326-26f87df8aa5c admin admin] Calling method '>' {{(pid=103453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:29:38.411463 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: INFO nova.api.openstack.requestlog [None req-a5451e7d-1fd5-43e4-8326-26f87df8aa5c admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.547401 Jul 15 20:29:38.411993 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: [pid: 103453|app: 0|req: 11/20] 10.222.0.66 () {60 vars in 1291 bytes} [Fri Jul 15 20:29:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:29:40.620335 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi [None req-f8b6439c-6078-41e1-91ff-0709d578ecaf admin admin] Calling method '>' {{(pid=103452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:29:40.621649 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: INFO nova.api.openstack.requestlog [None req-f8b6439c-6078-41e1-91ff-0709d578ecaf admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001599 Jul 15 20:29:40.622062 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: [pid: 103452|app: 0|req: 10/21] 10.222.0.66 () {54 vars in 930 bytes} [Fri Jul 15 20:29:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:29:41.052989 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi [None req-529cc527-d4d8-434a-917b-12a1b31335b0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "swap": 0, "vcpus": 1, "ram": 512, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "id": "1"}} {{(pid=103453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:29:41.074327 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: INFO nova.api.openstack.requestlog [None req-529cc527-d4d8-434a-917b-12a1b31335b0 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.445475 Jul 15 20:29:41.075236 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: [pid: 103453|app: 0|req: 12/22] 10.222.0.66 () {64 vars in 1282 bytes} [Fri Jul 15 20:29:40 2022] POST /compute/v2.1/flavors => generated 402 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 15 20:29:41.088990 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi [None req-d164517b-5caf-4214-8237-2683f7c622fc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:29:41.112966 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: INFO nova.api.openstack.requestlog [None req-d164517b-5caf-4214-8237-2683f7c622fc admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027713 Jul 15 20:29:41.113577 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: [pid: 103452|app: 0|req: 11/23] 10.222.0.66 () {64 vars in 1332 bytes} [Fri Jul 15 20:29:41 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:29:43.621158 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi [None req-529cc527-d4d8-434a-917b-12a1b31335b0 admin admin] Calling method '>' {{(pid=103453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:29:43.622158 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: INFO nova.api.openstack.requestlog [None req-529cc527-d4d8-434a-917b-12a1b31335b0 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002031 Jul 15 20:29:43.622727 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: [pid: 103453|app: 0|req: 13/24] 10.222.0.66 () {54 vars in 930 bytes} [Fri Jul 15 20:29:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:29:44.014836 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi [None req-c522a0e4-770e-491f-a73c-e2b48e566472 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "os-flavor-access:is_public": true, "disk": 20, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 2048, "name": "m1.small", "swap": 0}} {{(pid=103452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:29:44.033059 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: INFO nova.api.openstack.requestlog [None req-c522a0e4-770e-491f-a73c-e2b48e566472 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.404717 Jul 15 20:29:44.033612 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: [pid: 103452|app: 0|req: 12/25] 10.222.0.66 () {64 vars in 1282 bytes} [Fri Jul 15 20:29:43 2022] POST /compute/v2.1/flavors => generated 405 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 15 20:29:44.045682 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi [None req-282c4fa9-e5e8-4dde-b2b6-ccd682c36fa5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:29:44.068185 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: INFO nova.api.openstack.requestlog [None req-282c4fa9-e5e8-4dde-b2b6-ccd682c36fa5 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026309 Jul 15 20:29:44.068789 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: [pid: 103453|app: 0|req: 14/26] 10.222.0.66 () {64 vars in 1332 bytes} [Fri Jul 15 20:29:44 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:29:46.271731 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi [None req-c522a0e4-770e-491f-a73c-e2b48e566472 admin admin] Calling method '>' {{(pid=103452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:29:46.272905 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: INFO nova.api.openstack.requestlog [None req-c522a0e4-770e-491f-a73c-e2b48e566472 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001595 Jul 15 20:29:46.273431 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: [pid: 103452|app: 0|req: 13/27] 10.222.0.66 () {54 vars in 930 bytes} [Fri Jul 15 20:29:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:29:46.746137 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi [None req-8a8ab648-c051-47b5-8bd4-8843c53ec733 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "3", "swap": 0, "os-flavor-access:is_public": true, "disk": 40, "vcpus": 2, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096}} {{(pid=103453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:29:46.808369 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: INFO nova.api.openstack.requestlog [None req-8a8ab648-c051-47b5-8bd4-8843c53ec733 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.527277 Jul 15 20:29:46.810901 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: [pid: 103453|app: 0|req: 15/28] 10.222.0.66 () {64 vars in 1282 bytes} [Fri Jul 15 20:29:46 2022] POST /compute/v2.1/flavors => generated 406 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 20:29:46.835111 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi [None req-bae2c4ef-815e-4077-8ef6-2f179a875441 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:29:46.873694 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: INFO nova.api.openstack.requestlog [None req-bae2c4ef-815e-4077-8ef6-2f179a875441 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.054442 Jul 15 20:29:46.874791 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: [pid: 103452|app: 0|req: 14/29] 10.222.0.66 () {64 vars in 1332 bytes} [Fri Jul 15 20:29:46 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:29:49.085171 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi [None req-8a8ab648-c051-47b5-8bd4-8843c53ec733 admin admin] Calling method '>' {{(pid=103453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:29:49.086183 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: INFO nova.api.openstack.requestlog [None req-8a8ab648-c051-47b5-8bd4-8843c53ec733 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Jul 15 20:29:49.086603 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: [pid: 103453|app: 0|req: 16/30] 10.222.0.66 () {54 vars in 930 bytes} [Fri Jul 15 20:29:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:29:49.538196 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi [None req-b8e9aeea-88da-4e88-8671-5fe6a8c9fe19 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 8192, "swap": 0, "disk": 80, "rxtx_factor": 1.0, "vcpus": 4, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large"}} {{(pid=103452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:29:49.557362 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: INFO nova.api.openstack.requestlog [None req-b8e9aeea-88da-4e88-8671-5fe6a8c9fe19 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.464633 Jul 15 20:29:49.558430 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: [pid: 103452|app: 0|req: 15/31] 10.222.0.66 () {64 vars in 1282 bytes} [Fri Jul 15 20:29:49 2022] POST /compute/v2.1/flavors => generated 405 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 20:29:49.571005 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi [None req-4ed21254-cf46-4113-9015-57f207526036 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:29:49.595274 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: INFO nova.api.openstack.requestlog [None req-4ed21254-cf46-4113-9015-57f207526036 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028591 Jul 15 20:29:49.595846 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: [pid: 103453|app: 0|req: 17/32] 10.222.0.66 () {64 vars in 1332 bytes} [Fri Jul 15 20:29:49 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:29:51.873115 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi [None req-b8e9aeea-88da-4e88-8671-5fe6a8c9fe19 admin admin] Calling method '>' {{(pid=103452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:29:51.874137 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: INFO nova.api.openstack.requestlog [None req-b8e9aeea-88da-4e88-8671-5fe6a8c9fe19 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 Jul 15 20:29:51.885441 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: [pid: 103452|app: 0|req: 16/33] 10.222.0.66 () {54 vars in 930 bytes} [Fri Jul 15 20:29:51 2022] GET /compute/v2.1 => generated 388 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:29:52.361110 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi [None req-a5a0c668-ae25-4117-9e25-6e522681aa0e admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.xlarge", "disk": 160, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "rxtx_factor": 1.0}} {{(pid=103453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:29:52.381746 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: INFO nova.api.openstack.requestlog [None req-a5a0c668-ae25-4117-9e25-6e522681aa0e admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.500353 Jul 15 20:29:52.382304 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: [pid: 103453|app: 0|req: 18/34] 10.222.0.66 () {64 vars in 1282 bytes} [Fri Jul 15 20:29:51 2022] POST /compute/v2.1/flavors => generated 408 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 20:29:52.395370 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi [None req-944a077f-f14f-4e60-a801-589824171c9a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:29:52.399664 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG dbcounter [-] [103452] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:29:52.423248 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: INFO nova.api.openstack.requestlog [None req-944a077f-f14f-4e60-a801-589824171c9a admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031517 Jul 15 20:29:52.423828 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: [pid: 103452|app: 0|req: 17/35] 10.222.0.66 () {64 vars in 1332 bytes} [Fri Jul 15 20:29:52 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:30:12.068425 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi [None req-a5a0c668-ae25-4117-9e25-6e522681aa0e admin admin] Calling method '>' {{(pid=103453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:30:12.069466 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: INFO nova.api.openstack.requestlog [None req-a5a0c668-ae25-4117-9e25-6e522681aa0e admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Jul 15 20:30:12.069875 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: [pid: 103453|app: 0|req: 19/36] 10.222.0.66 () {54 vars in 930 bytes} [Fri Jul 15 20:30:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:30:12.081196 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG dbcounter [-] [103452] Writing DB stats nova_api:SELECT=5,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:30:12.486450 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi [None req-14b79e47-e09b-46ac-ae08-d9685e3b5f59 admin admin] Calling method '>' {{(pid=103452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:30:12.503126 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: INFO nova.api.openstack.requestlog [None req-14b79e47-e09b-46ac-ae08-d9685e3b5f59 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.427131 Jul 15 20:30:12.503654 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: [pid: 103452|app: 0|req: 18/37] 10.222.0.66 () {60 vars in 1291 bytes} [Fri Jul 15 20:30:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:30:13.583013 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi [None req-a5a0c668-ae25-4117-9e25-6e522681aa0e admin admin] Calling method '>' {{(pid=103453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:30:13.584017 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: INFO nova.api.openstack.requestlog [None req-a5a0c668-ae25-4117-9e25-6e522681aa0e admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Jul 15 20:30:13.584433 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: [pid: 103453|app: 0|req: 20/38] 10.222.0.66 () {56 vars in 1074 bytes} [Fri Jul 15 20:30:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 20:30:14.214821 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi [None req-8983b5bb-7144-4e21-b91e-6848cb64b9b8 admin admin] Calling method '>' {{(pid=103452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:30:14.220417 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: INFO nova.api.openstack.wsgi [None req-8983b5bb-7144-4e21-b91e-6848cb64b9b8 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 15 20:30:14.223635 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi [None req-8983b5bb-7144-4e21-b91e-6848cb64b9b8 admin admin] Request method failure captured: Jul 15 20:30:14.223635 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 15 20:30:14.223635 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: Accept: application/json Jul 15 20:30:14.223635 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: Accept-Encoding: gzip, deflate Jul 15 20:30:14.223635 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: Connection: keep-alive Jul 15 20:30:14.223635 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: Content-Length: 0 Jul 15 20:30:14.223635 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: Host: 10.222.0.66 Jul 15 20:30:14.223635 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: Openstack-Api-Version: compute 2.90 Jul 15 20:30:14.223635 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: Openstack-System-Scope: None Jul 15 20:30:14.223635 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: User-Agent: python-novaclient Jul 15 20:30:14.223635 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: X-Auth-Token: gAAAAABi0c5VAjYg8Uwexz8ZdyyGOStYSyYJt36CPZUB8bZh0wwwRBAFNDXl2h0IT79C3SHB9L6mXH4SMTILSmBDAQe0sQZ2iNqeZefhqxapX9nIx7-eohEUSHfasEZqEKmgyiGPHSHqLQmV919qetfbQSUrg5L0yd8MAsx2Dzh1bM0ZdS5O008 Jul 15 20:30:14.223635 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: X-Domain-Id: None Jul 15 20:30:14.223635 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: X-Domain-Name: None Jul 15 20:30:14.223635 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: X-Identity-Status: Confirmed Jul 15 20:30:14.223635 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: X-Is-Admin-Project: True Jul 15 20:30:14.223635 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: X-Openstack-Nova-Api-Version: 2.90 Jul 15 20:30:14.223635 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: X-Project-Domain-Id: default Jul 15 20:30:14.223635 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: X-Project-Domain-Name: Default Jul 15 20:30:14.223635 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: X-Project-Id: 090394e10e7f467d9c567173bebe0143 Jul 15 20:30:14.223635 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: X-Project-Name: admin Jul 15 20:30:14.223635 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: X-Role: admin,member,reader Jul 15 20:30:14.223635 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: X-Roles: admin,member,reader Jul 15 20:30:14.225526 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/090394e10e7f467d9c567173bebe0143"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_090394e10e7f467d9c567173bebe0143"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/090394e10e7f467d9c567173bebe0143"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/090394e10e7f467d9c567173bebe0143"}]}] Jul 15 20:30:14.225526 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: X-Tenant: admin Jul 15 20:30:14.225526 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: X-Tenant-Id: 090394e10e7f467d9c567173bebe0143 Jul 15 20:30:14.225526 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: X-Tenant-Name: admin Jul 15 20:30:14.225526 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: X-User: admin Jul 15 20:30:14.225526 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: X-User-Domain-Id: default Jul 15 20:30:14.225526 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: X-User-Domain-Name: Default Jul 15 20:30:14.225526 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: X-User-Id: 95a76fa60149455a8ad27ef586bc5044 Jul 15 20:30:14.225526 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: X-User-Name: admin Jul 15 20:30:14.225526 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: method: > Jul 15 20:30:14.225526 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: exception: Flavor 42 could not be found. Jul 15 20:30:14.225526 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: action_args: {'id': '42'} Jul 15 20:30:14.225526 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: {{(pid=103452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 20:30:14.225526 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:30:14.226595 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 15 20:30:14.226595 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 15 20:30:14.226595 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 15 20:30:14.226595 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 15 20:30:14.226595 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 15 20:30:14.226595 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 15 20:30:14.226595 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 15 20:30:14.226595 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 15 20:30:14.226595 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 15 20:30:14.226595 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 20:30:14.226595 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 15 20:30:14.226595 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 15 20:30:14.226595 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 15 20:30:14.226595 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi Jul 15 20:30:14.226595 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:30:14.226595 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi Jul 15 20:30:14.226595 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:30:14.226595 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:30:14.226595 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:30:14.227981 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 20:30:14.227981 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 20:30:14.227981 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 20:30:14.227981 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 20:30:14.227981 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 15 20:30:14.227981 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 15 20:30:14.227981 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 15 20:30:14.227981 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi Jul 15 20:30:14.227981 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:30:14.227981 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi Jul 15 20:30:14.227981 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:30:14.227981 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:30:14.227981 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:30:14.227981 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 20:30:14.227981 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 20:30:14.227981 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 15 20:30:14.227981 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi Jul 15 20:30:14.227981 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi [None req-8983b5bb-7144-4e21-b91e-6848cb64b9b8 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 20:30:14.229963 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: INFO nova.api.openstack.requestlog [None req-8983b5bb-7144-4e21-b91e-6848cb64b9b8 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.502063 Jul 15 20:30:14.229963 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: [pid: 103452|app: 0|req: 19/39] 10.222.0.66 () {60 vars in 1190 bytes} [Fri Jul 15 20:30:13 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 503 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 15 20:30:14.235396 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi [None req-6f7c6b89-9147-4724-9d02-a48fbe69b5af admin admin] Calling method '>' {{(pid=103453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:30:14.238315 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG dbcounter [-] [103453] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:30:14.258809 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: INFO nova.api.openstack.requestlog [None req-6f7c6b89-9147-4724-9d02-a48fbe69b5af admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026939 Jul 15 20:30:14.259342 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: [pid: 103453|app: 0|req: 21/40] 10.222.0.66 () {60 vars in 1210 bytes} [Fri Jul 15 20:30:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:30:14.269566 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi [None req-b5cd38ca-5e64-411f-b60e-347ac25a4910 admin admin] Calling method '>' {{(pid=103452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:30:14.291196 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: INFO nova.api.openstack.requestlog [None req-b5cd38ca-5e64-411f-b60e-347ac25a4910 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025225 Jul 15 20:30:14.291774 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: [pid: 103452|app: 0|req: 20/41] 10.222.0.66 () {60 vars in 1210 bytes} [Fri Jul 15 20:30:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 20:30:14.300962 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi [None req-d2d4dee7-ae38-41ab-9db6-ae97151d6792 admin admin] Calling method '>' {{(pid=103453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:30:14.308458 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: INFO nova.api.openstack.wsgi [None req-d2d4dee7-ae38-41ab-9db6-ae97151d6792 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 15 20:30:14.312076 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi [None req-d2d4dee7-ae38-41ab-9db6-ae97151d6792 admin admin] Request method failure captured: Jul 15 20:30:14.312076 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 15 20:30:14.312076 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: Accept: application/json Jul 15 20:30:14.312076 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: Accept-Encoding: gzip, deflate Jul 15 20:30:14.312076 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: Connection: keep-alive Jul 15 20:30:14.312076 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: Content-Length: 0 Jul 15 20:30:14.312076 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: Host: 10.222.0.66 Jul 15 20:30:14.312076 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: Openstack-Api-Version: compute 2.90 Jul 15 20:30:14.312076 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: Openstack-System-Scope: None Jul 15 20:30:14.312076 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: User-Agent: python-novaclient Jul 15 20:30:14.312076 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: X-Auth-Token: gAAAAABi0c5VAjYg8Uwexz8ZdyyGOStYSyYJt36CPZUB8bZh0wwwRBAFNDXl2h0IT79C3SHB9L6mXH4SMTILSmBDAQe0sQZ2iNqeZefhqxapX9nIx7-eohEUSHfasEZqEKmgyiGPHSHqLQmV919qetfbQSUrg5L0yd8MAsx2Dzh1bM0ZdS5O008 Jul 15 20:30:14.312076 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: X-Domain-Id: None Jul 15 20:30:14.312076 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: X-Domain-Name: None Jul 15 20:30:14.312076 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: X-Identity-Status: Confirmed Jul 15 20:30:14.312076 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: X-Is-Admin-Project: True Jul 15 20:30:14.312076 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: X-Openstack-Nova-Api-Version: 2.90 Jul 15 20:30:14.312076 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: X-Project-Domain-Id: default Jul 15 20:30:14.312076 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: X-Project-Domain-Name: Default Jul 15 20:30:14.312076 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: X-Project-Id: 090394e10e7f467d9c567173bebe0143 Jul 15 20:30:14.312076 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: X-Project-Name: admin Jul 15 20:30:14.312076 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: X-Role: admin,member,reader Jul 15 20:30:14.312076 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: X-Roles: admin,member,reader Jul 15 20:30:14.313372 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/090394e10e7f467d9c567173bebe0143"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_090394e10e7f467d9c567173bebe0143"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/090394e10e7f467d9c567173bebe0143"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/090394e10e7f467d9c567173bebe0143"}]}] Jul 15 20:30:14.313372 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: X-Tenant: admin Jul 15 20:30:14.313372 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: X-Tenant-Id: 090394e10e7f467d9c567173bebe0143 Jul 15 20:30:14.313372 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: X-Tenant-Name: admin Jul 15 20:30:14.313372 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: X-User: admin Jul 15 20:30:14.313372 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: X-User-Domain-Id: default Jul 15 20:30:14.313372 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: X-User-Domain-Name: Default Jul 15 20:30:14.313372 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: X-User-Id: 95a76fa60149455a8ad27ef586bc5044 Jul 15 20:30:14.313372 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: X-User-Name: admin Jul 15 20:30:14.313372 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: method: > Jul 15 20:30:14.313372 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: exception: Flavor 42 could not be found. Jul 15 20:30:14.313372 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: action_args: {'id': '42'} Jul 15 20:30:14.313372 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: {{(pid=103453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 20:30:14.313372 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:30:14.314159 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 15 20:30:14.314159 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 15 20:30:14.314159 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 15 20:30:14.314159 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 15 20:30:14.314159 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 15 20:30:14.314159 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 15 20:30:14.314159 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 15 20:30:14.314159 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 15 20:30:14.314159 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 15 20:30:14.314159 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 20:30:14.314159 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 15 20:30:14.314159 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 15 20:30:14.314159 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 15 20:30:14.314159 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi Jul 15 20:30:14.314159 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:30:14.314159 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi Jul 15 20:30:14.314159 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:30:14.314159 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:30:14.314159 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:30:14.315463 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 20:30:14.315463 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 20:30:14.315463 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 20:30:14.315463 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 20:30:14.315463 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 15 20:30:14.315463 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 15 20:30:14.315463 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 15 20:30:14.315463 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi Jul 15 20:30:14.315463 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:30:14.315463 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi Jul 15 20:30:14.315463 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:30:14.315463 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:30:14.315463 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:30:14.315463 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 20:30:14.315463 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 20:30:14.315463 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 15 20:30:14.315463 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi Jul 15 20:30:14.315463 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi [None req-d2d4dee7-ae38-41ab-9db6-ae97151d6792 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 20:30:14.316709 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: INFO nova.api.openstack.requestlog [None req-d2d4dee7-ae38-41ab-9db6-ae97151d6792 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016093 Jul 15 20:30:14.316709 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: [pid: 103453|app: 0|req: 22/42] 10.222.0.66 () {60 vars in 1190 bytes} [Fri Jul 15 20:30:14 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 15 20:30:15.283769 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi [None req-b5cd38ca-5e64-411f-b60e-347ac25a4910 admin admin] Calling method '>' {{(pid=103452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:30:15.284814 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: INFO nova.api.openstack.requestlog [None req-b5cd38ca-5e64-411f-b60e-347ac25a4910 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jul 15 20:30:15.285208 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: [pid: 103452|app: 0|req: 21/43] 10.222.0.66 () {56 vars in 1074 bytes} [Fri Jul 15 20:30:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:30:15.819965 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi [None req-3402dd18-f93a-47ee-9ff5-23bb5cebc3df admin admin] Calling method '>' {{(pid=103453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:30:15.825787 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: INFO nova.api.openstack.wsgi [None req-3402dd18-f93a-47ee-9ff5-23bb5cebc3df admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 15 20:30:15.827317 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi [None req-3402dd18-f93a-47ee-9ff5-23bb5cebc3df admin admin] Request method failure captured: Jul 15 20:30:15.827317 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 15 20:30:15.827317 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: Accept: application/json Jul 15 20:30:15.827317 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: Accept-Encoding: gzip, deflate Jul 15 20:30:15.827317 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: Connection: keep-alive Jul 15 20:30:15.827317 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: Content-Length: 0 Jul 15 20:30:15.827317 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: Host: 10.222.0.66 Jul 15 20:30:15.827317 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: Openstack-Api-Version: compute 2.90 Jul 15 20:30:15.827317 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: Openstack-System-Scope: None Jul 15 20:30:15.827317 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: User-Agent: python-novaclient Jul 15 20:30:15.827317 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: X-Auth-Token: gAAAAABi0c5XIbernUAofBHdHpy2NjcTL5DruaKViaLov-kNlx3FzscG1L7VUcUzsH_Ni6592-IfKwMLHDhW5SllijGQqxjMxXeQqq_PEuV7LfF8DqzvlI6RGULWFp4lL2PXIfzu9OrXhbPR83yJtCWwgKBaHav3v6FFbTr0nipj6uILUCPnT4Q Jul 15 20:30:15.827317 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: X-Domain-Id: None Jul 15 20:30:15.827317 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: X-Domain-Name: None Jul 15 20:30:15.827317 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: X-Identity-Status: Confirmed Jul 15 20:30:15.827317 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: X-Is-Admin-Project: True Jul 15 20:30:15.827317 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: X-Openstack-Nova-Api-Version: 2.90 Jul 15 20:30:15.827317 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: X-Project-Domain-Id: default Jul 15 20:30:15.827317 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: X-Project-Domain-Name: Default Jul 15 20:30:15.827317 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: X-Project-Id: 090394e10e7f467d9c567173bebe0143 Jul 15 20:30:15.827317 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: X-Project-Name: admin Jul 15 20:30:15.827317 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: X-Role: admin,member,reader Jul 15 20:30:15.827317 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: X-Roles: admin,member,reader Jul 15 20:30:15.828765 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/090394e10e7f467d9c567173bebe0143"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_090394e10e7f467d9c567173bebe0143"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/090394e10e7f467d9c567173bebe0143"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/090394e10e7f467d9c567173bebe0143"}]}] Jul 15 20:30:15.828765 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: X-Tenant: admin Jul 15 20:30:15.828765 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: X-Tenant-Id: 090394e10e7f467d9c567173bebe0143 Jul 15 20:30:15.828765 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: X-Tenant-Name: admin Jul 15 20:30:15.828765 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: X-User: admin Jul 15 20:30:15.828765 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: X-User-Domain-Id: default Jul 15 20:30:15.828765 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: X-User-Domain-Name: Default Jul 15 20:30:15.828765 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: X-User-Id: 95a76fa60149455a8ad27ef586bc5044 Jul 15 20:30:15.828765 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: X-User-Name: admin Jul 15 20:30:15.828765 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: method: > Jul 15 20:30:15.828765 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: exception: Flavor 84 could not be found. Jul 15 20:30:15.828765 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: action_args: {'id': '84'} Jul 15 20:30:15.828765 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: {{(pid=103453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 20:30:15.828765 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:30:15.832084 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 15 20:30:15.832084 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 15 20:30:15.832084 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 15 20:30:15.832084 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 15 20:30:15.832084 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 15 20:30:15.832084 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 15 20:30:15.832084 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 15 20:30:15.832084 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 15 20:30:15.832084 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 15 20:30:15.832084 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 20:30:15.832084 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 15 20:30:15.832084 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 15 20:30:15.832084 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 15 20:30:15.832084 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi Jul 15 20:30:15.832084 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:30:15.832084 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi Jul 15 20:30:15.832084 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:30:15.832084 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:30:15.832084 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:30:15.833455 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 20:30:15.833455 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 20:30:15.833455 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 20:30:15.833455 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 20:30:15.833455 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 15 20:30:15.833455 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 15 20:30:15.833455 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 15 20:30:15.833455 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi Jul 15 20:30:15.833455 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:30:15.833455 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi Jul 15 20:30:15.833455 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:30:15.833455 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:30:15.833455 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:30:15.833455 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 20:30:15.833455 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 20:30:15.833455 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 15 20:30:15.833455 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi Jul 15 20:30:15.833455 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi [None req-3402dd18-f93a-47ee-9ff5-23bb5cebc3df admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 20:30:15.834647 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: INFO nova.api.openstack.requestlog [None req-3402dd18-f93a-47ee-9ff5-23bb5cebc3df admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.404371 Jul 15 20:30:15.834647 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: [pid: 103453|app: 0|req: 23/44] 10.222.0.66 () {60 vars in 1190 bytes} [Fri Jul 15 20:30:15 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 405 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 15 20:30:15.838298 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi [None req-b7bf2840-82cc-44f6-9628-beafeb3f77d0 admin admin] Calling method '>' {{(pid=103452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:30:15.851779 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: INFO nova.api.openstack.requestlog [None req-b7bf2840-82cc-44f6-9628-beafeb3f77d0 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017004 Jul 15 20:30:15.852340 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: [pid: 103452|app: 0|req: 22/45] 10.222.0.66 () {60 vars in 1210 bytes} [Fri Jul 15 20:30:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 20:30:15.862420 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi [None req-9985dea8-a964-4363-880e-f4ea09218ca1 admin admin] Calling method '>' {{(pid=103453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:30:15.876733 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: INFO nova.api.openstack.requestlog [None req-9985dea8-a964-4363-880e-f4ea09218ca1 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017765 Jul 15 20:30:15.877256 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: [pid: 103453|app: 0|req: 24/46] 10.222.0.66 () {60 vars in 1210 bytes} [Fri Jul 15 20:30:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:30:15.886340 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi [None req-13746f26-e894-4b5f-8fb2-4e22b5145140 admin admin] Calling method '>' {{(pid=103452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:30:15.891631 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: INFO nova.api.openstack.wsgi [None req-13746f26-e894-4b5f-8fb2-4e22b5145140 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 15 20:30:15.893141 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi [None req-13746f26-e894-4b5f-8fb2-4e22b5145140 admin admin] Request method failure captured: Jul 15 20:30:15.893141 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 15 20:30:15.893141 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: Accept: application/json Jul 15 20:30:15.893141 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: Accept-Encoding: gzip, deflate Jul 15 20:30:15.893141 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: Connection: keep-alive Jul 15 20:30:15.893141 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: Content-Length: 0 Jul 15 20:30:15.893141 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: Host: 10.222.0.66 Jul 15 20:30:15.893141 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: Openstack-Api-Version: compute 2.90 Jul 15 20:30:15.893141 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: Openstack-System-Scope: None Jul 15 20:30:15.893141 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: User-Agent: python-novaclient Jul 15 20:30:15.893141 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: X-Auth-Token: gAAAAABi0c5XIbernUAofBHdHpy2NjcTL5DruaKViaLov-kNlx3FzscG1L7VUcUzsH_Ni6592-IfKwMLHDhW5SllijGQqxjMxXeQqq_PEuV7LfF8DqzvlI6RGULWFp4lL2PXIfzu9OrXhbPR83yJtCWwgKBaHav3v6FFbTr0nipj6uILUCPnT4Q Jul 15 20:30:15.893141 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: X-Domain-Id: None Jul 15 20:30:15.893141 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: X-Domain-Name: None Jul 15 20:30:15.893141 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: X-Identity-Status: Confirmed Jul 15 20:30:15.893141 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: X-Is-Admin-Project: True Jul 15 20:30:15.893141 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: X-Openstack-Nova-Api-Version: 2.90 Jul 15 20:30:15.893141 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: X-Project-Domain-Id: default Jul 15 20:30:15.893141 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: X-Project-Domain-Name: Default Jul 15 20:30:15.893141 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: X-Project-Id: 090394e10e7f467d9c567173bebe0143 Jul 15 20:30:15.893141 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: X-Project-Name: admin Jul 15 20:30:15.893141 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: X-Role: admin,member,reader Jul 15 20:30:15.893141 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: X-Roles: admin,member,reader Jul 15 20:30:15.894550 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/090394e10e7f467d9c567173bebe0143"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_090394e10e7f467d9c567173bebe0143"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/090394e10e7f467d9c567173bebe0143"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/090394e10e7f467d9c567173bebe0143"}]}] Jul 15 20:30:15.894550 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: X-Tenant: admin Jul 15 20:30:15.894550 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: X-Tenant-Id: 090394e10e7f467d9c567173bebe0143 Jul 15 20:30:15.894550 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: X-Tenant-Name: admin Jul 15 20:30:15.894550 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: X-User: admin Jul 15 20:30:15.894550 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: X-User-Domain-Id: default Jul 15 20:30:15.894550 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: X-User-Domain-Name: Default Jul 15 20:30:15.894550 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: X-User-Id: 95a76fa60149455a8ad27ef586bc5044 Jul 15 20:30:15.894550 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: X-User-Name: admin Jul 15 20:30:15.894550 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: method: > Jul 15 20:30:15.894550 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: exception: Flavor 84 could not be found. Jul 15 20:30:15.894550 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: action_args: {'id': '84'} Jul 15 20:30:15.894550 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: {{(pid=103452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 20:30:15.894550 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:30:15.895471 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 15 20:30:15.895471 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 15 20:30:15.895471 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 15 20:30:15.895471 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 15 20:30:15.895471 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 15 20:30:15.895471 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 15 20:30:15.895471 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 15 20:30:15.895471 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 15 20:30:15.895471 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 15 20:30:15.895471 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 20:30:15.895471 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 15 20:30:15.895471 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 15 20:30:15.895471 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 15 20:30:15.895471 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi Jul 15 20:30:15.895471 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:30:15.895471 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi Jul 15 20:30:15.895471 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:30:15.895471 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:30:15.895471 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:30:15.896912 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 20:30:15.896912 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 20:30:15.896912 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 20:30:15.896912 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 20:30:15.896912 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 15 20:30:15.896912 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 15 20:30:15.896912 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 15 20:30:15.896912 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi Jul 15 20:30:15.896912 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:30:15.896912 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi Jul 15 20:30:15.896912 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:30:15.896912 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:30:15.896912 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:30:15.896912 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 20:30:15.896912 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 20:30:15.896912 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 15 20:30:15.896912 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi Jul 15 20:30:15.896912 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi [None req-13746f26-e894-4b5f-8fb2-4e22b5145140 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 20:30:15.898237 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: INFO nova.api.openstack.requestlog [None req-13746f26-e894-4b5f-8fb2-4e22b5145140 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011725 Jul 15 20:30:15.898237 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: [pid: 103452|app: 0|req: 23/47] 10.222.0.66 () {60 vars in 1190 bytes} [Fri Jul 15 20:30:15 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 15 20:30:16.879507 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi [None req-9985dea8-a964-4363-880e-f4ea09218ca1 admin admin] Calling method '>' {{(pid=103453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:30:16.880622 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: INFO nova.api.openstack.requestlog [None req-9985dea8-a964-4363-880e-f4ea09218ca1 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jul 15 20:30:16.881027 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: [pid: 103453|app: 0|req: 25/48] 10.222.0.66 () {56 vars in 1074 bytes} [Fri Jul 15 20:30:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:30:17.403807 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi [None req-22c0464e-8b0b-42d9-b418-de750a9e180c admin admin] Calling method '>' {{(pid=103452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:30:17.410467 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: INFO nova.api.openstack.wsgi [None req-22c0464e-8b0b-42d9-b418-de750a9e180c admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 15 20:30:17.411976 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi [None req-22c0464e-8b0b-42d9-b418-de750a9e180c admin admin] Request method failure captured: Jul 15 20:30:17.411976 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 15 20:30:17.411976 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: Accept: application/json Jul 15 20:30:17.411976 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: Accept-Encoding: gzip, deflate Jul 15 20:30:17.411976 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: Connection: keep-alive Jul 15 20:30:17.411976 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: Content-Length: 0 Jul 15 20:30:17.411976 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: Host: 10.222.0.66 Jul 15 20:30:17.411976 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: Openstack-Api-Version: compute 2.90 Jul 15 20:30:17.411976 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: Openstack-System-Scope: None Jul 15 20:30:17.411976 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: User-Agent: python-novaclient Jul 15 20:30:17.411976 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: X-Auth-Token: gAAAAABi0c5Y-rxKtMLjPKmRkEOZj3n_1HPsajjGr_xWI45Q9sKczemDRXmgqlMhc8oXBBMTwo92SAGHQyms3J6r_swILIOejZQcgPUJLZFn1DNLSZKTdViYFCCLSoI9oYGItCV-bNMcrFJVFsHof_jtEjduO6mia-E5NOSHh4ovNezcp8-90wc Jul 15 20:30:17.411976 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: X-Domain-Id: None Jul 15 20:30:17.411976 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: X-Domain-Name: None Jul 15 20:30:17.411976 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: X-Identity-Status: Confirmed Jul 15 20:30:17.411976 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: X-Is-Admin-Project: True Jul 15 20:30:17.411976 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: X-Openstack-Nova-Api-Version: 2.90 Jul 15 20:30:17.411976 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: X-Project-Domain-Id: default Jul 15 20:30:17.411976 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: X-Project-Domain-Name: Default Jul 15 20:30:17.411976 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: X-Project-Id: 090394e10e7f467d9c567173bebe0143 Jul 15 20:30:17.411976 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: X-Project-Name: admin Jul 15 20:30:17.411976 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: X-Role: admin,member,reader Jul 15 20:30:17.411976 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: X-Roles: admin,member,reader Jul 15 20:30:17.413573 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/090394e10e7f467d9c567173bebe0143"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_090394e10e7f467d9c567173bebe0143"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/090394e10e7f467d9c567173bebe0143"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/090394e10e7f467d9c567173bebe0143"}]}] Jul 15 20:30:17.413573 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: X-Tenant: admin Jul 15 20:30:17.413573 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: X-Tenant-Id: 090394e10e7f467d9c567173bebe0143 Jul 15 20:30:17.413573 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: X-Tenant-Name: admin Jul 15 20:30:17.413573 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: X-User: admin Jul 15 20:30:17.413573 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: X-User-Domain-Id: default Jul 15 20:30:17.413573 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: X-User-Domain-Name: Default Jul 15 20:30:17.413573 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: X-User-Id: 95a76fa60149455a8ad27ef586bc5044 Jul 15 20:30:17.413573 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: X-User-Name: admin Jul 15 20:30:17.413573 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: method: > Jul 15 20:30:17.413573 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: exception: Flavor 451 could not be found. Jul 15 20:30:17.413573 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: action_args: {'id': '451'} Jul 15 20:30:17.413573 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: {{(pid=103452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 20:30:17.413573 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:30:17.414580 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 15 20:30:17.414580 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 15 20:30:17.414580 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 15 20:30:17.414580 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 15 20:30:17.414580 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 15 20:30:17.414580 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 15 20:30:17.414580 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 15 20:30:17.414580 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 15 20:30:17.414580 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 15 20:30:17.414580 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 20:30:17.414580 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 15 20:30:17.414580 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 15 20:30:17.414580 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 15 20:30:17.414580 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi Jul 15 20:30:17.414580 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:30:17.414580 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi Jul 15 20:30:17.414580 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:30:17.414580 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:30:17.414580 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:30:17.416294 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 20:30:17.416294 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 20:30:17.416294 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 20:30:17.416294 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 20:30:17.416294 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 15 20:30:17.416294 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 15 20:30:17.416294 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 15 20:30:17.416294 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi Jul 15 20:30:17.416294 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:30:17.416294 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi Jul 15 20:30:17.416294 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:30:17.416294 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:30:17.416294 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:30:17.416294 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 20:30:17.416294 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 20:30:17.416294 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 15 20:30:17.416294 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: ERROR nova.api.openstack.wsgi Jul 15 20:30:17.416294 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi [None req-22c0464e-8b0b-42d9-b418-de750a9e180c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 20:30:17.418125 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: INFO nova.api.openstack.requestlog [None req-22c0464e-8b0b-42d9-b418-de750a9e180c admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.393514 Jul 15 20:30:17.418125 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: [pid: 103452|app: 0|req: 24/49] 10.222.0.66 () {60 vars in 1193 bytes} [Fri Jul 15 20:30:17 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 15 20:30:17.424205 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi [None req-edf0ed8f-5e07-47d0-96ac-e62b13acf528 admin admin] Calling method '>' {{(pid=103453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:30:17.444326 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: INFO nova.api.openstack.requestlog [None req-edf0ed8f-5e07-47d0-96ac-e62b13acf528 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023552 Jul 15 20:30:17.445257 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: [pid: 103453|app: 0|req: 26/50] 10.222.0.66 () {60 vars in 1210 bytes} [Fri Jul 15 20:30:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:30:17.454743 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi [None req-ec29332b-e5ff-4d89-bbaf-5659bf71b33d admin admin] Calling method '>' {{(pid=103452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:30:17.469969 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: INFO nova.api.openstack.requestlog [None req-ec29332b-e5ff-4d89-bbaf-5659bf71b33d admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018772 Jul 15 20:30:17.470502 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: [pid: 103452|app: 0|req: 25/51] 10.222.0.66 () {60 vars in 1210 bytes} [Fri Jul 15 20:30:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 20:30:17.480566 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi [None req-277c7489-48c3-430e-a29b-b87fb3efa372 admin admin] Calling method '>' {{(pid=103453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:30:17.485899 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: INFO nova.api.openstack.wsgi [None req-277c7489-48c3-430e-a29b-b87fb3efa372 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 15 20:30:17.487389 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi [None req-277c7489-48c3-430e-a29b-b87fb3efa372 admin admin] Request method failure captured: Jul 15 20:30:17.487389 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 15 20:30:17.487389 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: Accept: application/json Jul 15 20:30:17.487389 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: Accept-Encoding: gzip, deflate Jul 15 20:30:17.487389 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: Connection: keep-alive Jul 15 20:30:17.487389 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: Content-Length: 0 Jul 15 20:30:17.487389 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: Host: 10.222.0.66 Jul 15 20:30:17.487389 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: Openstack-Api-Version: compute 2.90 Jul 15 20:30:17.487389 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: Openstack-System-Scope: None Jul 15 20:30:17.487389 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: User-Agent: python-novaclient Jul 15 20:30:17.487389 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: X-Auth-Token: gAAAAABi0c5Y-rxKtMLjPKmRkEOZj3n_1HPsajjGr_xWI45Q9sKczemDRXmgqlMhc8oXBBMTwo92SAGHQyms3J6r_swILIOejZQcgPUJLZFn1DNLSZKTdViYFCCLSoI9oYGItCV-bNMcrFJVFsHof_jtEjduO6mia-E5NOSHh4ovNezcp8-90wc Jul 15 20:30:17.487389 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: X-Domain-Id: None Jul 15 20:30:17.487389 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: X-Domain-Name: None Jul 15 20:30:17.487389 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: X-Identity-Status: Confirmed Jul 15 20:30:17.487389 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: X-Is-Admin-Project: True Jul 15 20:30:17.487389 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: X-Openstack-Nova-Api-Version: 2.90 Jul 15 20:30:17.487389 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: X-Project-Domain-Id: default Jul 15 20:30:17.487389 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: X-Project-Domain-Name: Default Jul 15 20:30:17.487389 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: X-Project-Id: 090394e10e7f467d9c567173bebe0143 Jul 15 20:30:17.487389 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: X-Project-Name: admin Jul 15 20:30:17.487389 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: X-Role: admin,member,reader Jul 15 20:30:17.487389 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: X-Roles: admin,member,reader Jul 15 20:30:17.488930 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/090394e10e7f467d9c567173bebe0143"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_090394e10e7f467d9c567173bebe0143"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/090394e10e7f467d9c567173bebe0143"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/090394e10e7f467d9c567173bebe0143"}]}] Jul 15 20:30:17.488930 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: X-Tenant: admin Jul 15 20:30:17.488930 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: X-Tenant-Id: 090394e10e7f467d9c567173bebe0143 Jul 15 20:30:17.488930 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: X-Tenant-Name: admin Jul 15 20:30:17.488930 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: X-User: admin Jul 15 20:30:17.488930 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: X-User-Domain-Id: default Jul 15 20:30:17.488930 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: X-User-Domain-Name: Default Jul 15 20:30:17.488930 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: X-User-Id: 95a76fa60149455a8ad27ef586bc5044 Jul 15 20:30:17.488930 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: X-User-Name: admin Jul 15 20:30:17.488930 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: method: > Jul 15 20:30:17.488930 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: exception: Flavor 451 could not be found. Jul 15 20:30:17.488930 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: action_args: {'id': '451'} Jul 15 20:30:17.488930 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: {{(pid=103453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 20:30:17.488930 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:30:17.490949 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 15 20:30:17.490949 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 15 20:30:17.490949 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 15 20:30:17.490949 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 15 20:30:17.490949 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 15 20:30:17.490949 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 15 20:30:17.490949 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 15 20:30:17.490949 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 15 20:30:17.490949 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 15 20:30:17.490949 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 20:30:17.490949 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 15 20:30:17.490949 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 15 20:30:17.490949 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 15 20:30:17.490949 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi Jul 15 20:30:17.490949 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:30:17.490949 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi Jul 15 20:30:17.490949 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:30:17.490949 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:30:17.490949 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:30:17.492237 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 20:30:17.492237 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 20:30:17.492237 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 20:30:17.492237 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 20:30:17.492237 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 15 20:30:17.492237 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 15 20:30:17.492237 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 15 20:30:17.492237 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi Jul 15 20:30:17.492237 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:30:17.492237 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi Jul 15 20:30:17.492237 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:30:17.492237 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:30:17.492237 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:30:17.492237 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 20:30:17.492237 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 20:30:17.492237 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 15 20:30:17.492237 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: ERROR nova.api.openstack.wsgi Jul 15 20:30:17.492237 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi [None req-277c7489-48c3-430e-a29b-b87fb3efa372 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 20:30:17.493470 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: INFO nova.api.openstack.requestlog [None req-277c7489-48c3-430e-a29b-b87fb3efa372 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012380 Jul 15 20:30:17.493470 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: [pid: 103453|app: 0|req: 27/52] 10.222.0.66 () {60 vars in 1193 bytes} [Fri Jul 15 20:30:17 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 15 20:30:18.469248 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi [None req-ec29332b-e5ff-4d89-bbaf-5659bf71b33d admin admin] Calling method '>' {{(pid=103452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:30:18.470294 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: INFO nova.api.openstack.requestlog [None req-ec29332b-e5ff-4d89-bbaf-5659bf71b33d admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Jul 15 20:30:18.470686 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: [pid: 103452|app: 0|req: 26/53] 10.222.0.66 () {56 vars in 1074 bytes} [Fri Jul 15 20:30:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:30:18.994176 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi [None req-d961fac5-70a1-4731-adc1-3bef28f4bf71 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:30:19.014022 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: INFO nova.api.openstack.requestlog [None req-d961fac5-70a1-4731-adc1-3bef28f4bf71 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.402131 Jul 15 20:30:19.014564 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: [pid: 103453|app: 0|req: 28/54] 10.222.0.66 () {64 vars in 1235 bytes} [Fri Jul 15 20:30:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 20:30:19.985470 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi [None req-ec29332b-e5ff-4d89-bbaf-5659bf71b33d admin admin] Calling method '>' {{(pid=103452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:30:19.986481 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: INFO nova.api.openstack.requestlog [None req-ec29332b-e5ff-4d89-bbaf-5659bf71b33d admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Jul 15 20:30:19.986866 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: [pid: 103452|app: 0|req: 27/55] 10.222.0.66 () {56 vars in 1074 bytes} [Fri Jul 15 20:30:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:30:20.508239 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi [None req-7f5986b8-0bf4-4041-9946-67abd173784c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:30:20.528942 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: INFO nova.api.openstack.requestlog [None req-7f5986b8-0bf4-4041-9946-67abd173784c admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.402959 Jul 15 20:30:20.529487 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: [pid: 103453|app: 0|req: 29/56] 10.222.0.66 () {64 vars in 1235 bytes} [Fri Jul 15 20:30:20 2022] POST /compute/v2.1/flavors => generated 405 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 20:30:21.510045 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi [None req-ec29332b-e5ff-4d89-bbaf-5659bf71b33d admin admin] Calling method '>' {{(pid=103452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:30:21.511052 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: INFO nova.api.openstack.requestlog [None req-ec29332b-e5ff-4d89-bbaf-5659bf71b33d admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Jul 15 20:30:21.511432 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: [pid: 103452|app: 0|req: 28/57] 10.222.0.66 () {56 vars in 1074 bytes} [Fri Jul 15 20:30:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:30:22.037517 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi [None req-fbbb239c-de3f-4f9c-b9f2-5fd47b93b908 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:30:22.055841 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: INFO nova.api.openstack.requestlog [None req-fbbb239c-de3f-4f9c-b9f2-5fd47b93b908 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.406628 Jul 15 20:30:22.056405 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: [pid: 103453|app: 0|req: 30/58] 10.222.0.66 () {64 vars in 1235 bytes} [Fri Jul 15 20:30:21 2022] POST /compute/v2.1/flavors => generated 407 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 20:30:23.157257 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi [None req-ec29332b-e5ff-4d89-bbaf-5659bf71b33d admin admin] Calling method '>' {{(pid=103452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:30:23.158273 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: INFO nova.api.openstack.requestlog [None req-ec29332b-e5ff-4d89-bbaf-5659bf71b33d admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Jul 15 20:30:23.158671 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: [pid: 103452|app: 0|req: 29/59] 10.222.0.66 () {56 vars in 1074 bytes} [Fri Jul 15 20:30:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:30:23.695600 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi [None req-e988ebb8-9299-4549-9240-bc7ce7417ce0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:30:23.712361 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: INFO nova.api.openstack.requestlog [None req-e988ebb8-9299-4549-9240-bc7ce7417ce0 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.410803 Jul 15 20:30:23.712860 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: [pid: 103453|app: 0|req: 31/60] 10.222.0.66 () {64 vars in 1235 bytes} [Fri Jul 15 20:30:23 2022] POST /compute/v2.1/flavors => generated 409 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 20:30:24.694604 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi [None req-ec29332b-e5ff-4d89-bbaf-5659bf71b33d admin admin] Calling method '>' {{(pid=103452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:30:24.695615 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: INFO nova.api.openstack.requestlog [None req-ec29332b-e5ff-4d89-bbaf-5659bf71b33d admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Jul 15 20:30:24.696010 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: [pid: 103452|app: 0|req: 30/61] 10.222.0.66 () {56 vars in 1074 bytes} [Fri Jul 15 20:30:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:30:25.220918 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi [None req-0685bf61-82cb-4e9c-b52e-a08f1c7650f9 admin admin] Calling method '>' {{(pid=103453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:30:25.239830 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: INFO nova.api.openstack.requestlog [None req-0685bf61-82cb-4e9c-b52e-a08f1c7650f9 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.404837 Jul 15 20:30:25.240338 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: [pid: 103453|app: 0|req: 32/62] 10.222.0.66 () {60 vars in 1202 bytes} [Fri Jul 15 20:30:24 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:31:16.825611 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi [None req-ec29332b-e5ff-4d89-bbaf-5659bf71b33d admin admin] Calling method '>' {{(pid=103452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:31:16.826619 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: INFO nova.api.openstack.requestlog [None req-ec29332b-e5ff-4d89-bbaf-5659bf71b33d admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Jul 15 20:31:16.827008 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: [pid: 103452|app: 0|req: 31/63] 10.222.0.66 () {54 vars in 930 bytes} [Fri Jul 15 20:31:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 20:31:16.837351 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG dbcounter [-] [103453] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:31:17.225282 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi [None req-c0186573-5d6d-422b-b2ba-592938528fe6 admin admin] Calling method '>' {{(pid=103453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:31:17.243998 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: INFO nova.api.openstack.requestlog [None req-c0186573-5d6d-422b-b2ba-592938528fe6 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.411015 Jul 15 20:31:17.244579 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: [pid: 103453|app: 0|req: 33/64] 10.222.0.66 () {60 vars in 1291 bytes} [Fri Jul 15 20:31:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:31:17.267495 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi [None req-3b5a62a5-cb11-41da-a745-16264e46b0b1 admin admin] Calling method '>' {{(pid=103452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:31:17.271010 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG dbcounter [-] [103452] Writing DB stats nova_api:SELECT=14 {{(pid=103452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:31:17.277443 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: INFO nova.api.openstack.requestlog [None req-3b5a62a5-cb11-41da-a745-16264e46b0b1 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013506 Jul 15 20:31:17.277961 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: [pid: 103452|app: 0|req: 32/65] 10.222.0.66 () {60 vars in 1282 bytes} [Fri Jul 15 20:31:17 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:31:17.289119 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi [None req-050bb168-5404-48a5-b20a-5209d19d9dd2 admin admin] Calling method '>' {{(pid=103453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:31:17.296989 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: INFO nova.api.openstack.requestlog [None req-050bb168-5404-48a5-b20a-5209d19d9dd2 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011376 Jul 15 20:31:17.297493 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: [pid: 103453|app: 0|req: 34/66] 10.222.0.66 () {60 vars in 1285 bytes} [Fri Jul 15 20:31:17 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:31:17.309157 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi [None req-d3cf9124-50c5-4c4d-9ec2-b04492267b06 admin admin] Calling method '>' {{(pid=103452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:31:17.316730 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: INFO nova.api.openstack.requestlog [None req-d3cf9124-50c5-4c4d-9ec2-b04492267b06 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011321 Jul 15 20:31:17.317237 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: [pid: 103452|app: 0|req: 33/67] 10.222.0.66 () {60 vars in 1285 bytes} [Fri Jul 15 20:31:17 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:31:17.328863 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi [None req-630f38f5-81eb-46e8-87b4-22fd521f4a48 admin admin] Calling method '>' {{(pid=103453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:31:17.336145 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: INFO nova.api.openstack.requestlog [None req-630f38f5-81eb-46e8-87b4-22fd521f4a48 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010822 Jul 15 20:31:17.336682 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: [pid: 103453|app: 0|req: 35/68] 10.222.0.66 () {60 vars in 1282 bytes} [Fri Jul 15 20:31:17 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:34:38.260587 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi [None req-d3cf9124-50c5-4c4d-9ec2-b04492267b06 admin admin] Calling method '>' {{(pid=103452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:34:38.261603 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: INFO nova.api.openstack.requestlog [None req-d3cf9124-50c5-4c4d-9ec2-b04492267b06 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Jul 15 20:34:38.261993 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: [pid: 103452|app: 0|req: 34/69] 10.222.0.66 () {56 vars in 1074 bytes} [Fri Jul 15 20:34:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:34:38.408641 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG dbcounter [-] [103453] Writing DB stats nova_api:SELECT=6 {{(pid=103453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:34:38.569628 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi [None req-37d101a9-7558-4508-b181-f670d441b075 admin admin] Calling method '>' {{(pid=103453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:34:38.570839 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 15 20:34:38.570839 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: warnings.warn(msg) Jul 15 20:34:38.572062 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG oslo_concurrency.lockutils [None req-37d101a9-7558-4508-b181-f670d441b075 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:34:38.572532 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG oslo_concurrency.lockutils [None req-37d101a9-7558-4508-b181-f670d441b075 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:34:38.573324 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG oslo_concurrency.lockutils [None req-37d101a9-7558-4508-b181-f670d441b075 admin admin] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:34:38.573751 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG oslo_concurrency.lockutils [None req-37d101a9-7558-4508-b181-f670d441b075 admin admin] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:34:38.607265 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: INFO nova.api.openstack.requestlog [None req-37d101a9-7558-4508-b181-f670d441b075 admin admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.200103 Jul 15 20:34:38.607814 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: [pid: 103453|app: 0|req: 36/70] 10.222.0.66 () {60 vars in 1193 bytes} [Fri Jul 15 20:34:38 2022] GET /compute/v2.1/os-services => generated 794 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 20:34:39.435099 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi [None req-d3cf9124-50c5-4c4d-9ec2-b04492267b06 admin admin] Calling method '>' {{(pid=103452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:34:39.436114 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: INFO nova.api.openstack.requestlog [None req-d3cf9124-50c5-4c4d-9ec2-b04492267b06 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Jul 15 20:34:39.436537 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: [pid: 103452|app: 0|req: 35/71] 10.222.0.66 () {56 vars in 1074 bytes} [Fri Jul 15 20:34:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:34:39.635607 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi [None req-27f12771-9092-4be6-9cb8-206e077b3909 admin admin] Calling method '>' {{(pid=103453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:34:39.636813 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 15 20:34:39.636813 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: warnings.warn(msg) Jul 15 20:34:39.638004 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG oslo_concurrency.lockutils [None req-27f12771-9092-4be6-9cb8-206e077b3909 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:34:39.638478 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG oslo_concurrency.lockutils [None req-27f12771-9092-4be6-9cb8-206e077b3909 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:34:39.639270 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG oslo_concurrency.lockutils [None req-27f12771-9092-4be6-9cb8-206e077b3909 admin admin] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:34:39.639700 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG oslo_concurrency.lockutils [None req-27f12771-9092-4be6-9cb8-206e077b3909 admin admin] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:34:39.659323 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: INFO nova.api.openstack.requestlog [None req-27f12771-9092-4be6-9cb8-206e077b3909 admin admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.079334 Jul 15 20:34:39.659864 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: [pid: 103453|app: 0|req: 37/72] 10.222.0.66 () {60 vars in 1193 bytes} [Fri Jul 15 20:34:39 2022] GET /compute/v2.1/os-services => generated 794 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 20:34:50.941240 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi [None req-d3cf9124-50c5-4c4d-9ec2-b04492267b06 admin admin] Calling method '>' {{(pid=103452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:34:50.942270 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: INFO nova.api.openstack.requestlog [None req-d3cf9124-50c5-4c4d-9ec2-b04492267b06 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Jul 15 20:34:50.942686 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: [pid: 103452|app: 0|req: 36/73] 10.222.0.66 () {56 vars in 1074 bytes} [Fri Jul 15 20:34:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:34:51.084731 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG dbcounter [-] [103453] Writing DB stats nova_cell0:SELECT=4 {{(pid=103453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:34:51.085976 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG dbcounter [-] [103453] Writing DB stats nova_cell1:SELECT=4 {{(pid=103453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:34:51.086678 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG dbcounter [-] [103453] Writing DB stats nova_api:SELECT=8 {{(pid=103453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:34:51.135423 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi [None req-e561457c-9a4c-4bcc-b9e8-1086010c2818 admin admin] Calling method '>' {{(pid=103453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:34:51.136607 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 15 20:34:51.136607 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: warnings.warn(msg) Jul 15 20:34:51.137855 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG oslo_concurrency.lockutils [None req-e561457c-9a4c-4bcc-b9e8-1086010c2818 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:34:51.138304 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG oslo_concurrency.lockutils [None req-e561457c-9a4c-4bcc-b9e8-1086010c2818 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:34:51.139094 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG oslo_concurrency.lockutils [None req-e561457c-9a4c-4bcc-b9e8-1086010c2818 admin admin] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:34:51.139527 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG oslo_concurrency.lockutils [None req-e561457c-9a4c-4bcc-b9e8-1086010c2818 admin admin] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:34:51.165248 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: INFO nova.api.openstack.requestlog [None req-e561457c-9a4c-4bcc-b9e8-1086010c2818 admin admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.084777 Jul 15 20:34:51.165729 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: [pid: 103453|app: 0|req: 38/74] 10.222.0.66 () {60 vars in 1193 bytes} [Fri Jul 15 20:34:51 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:34:52.008206 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: DEBUG nova.api.openstack.wsgi [None req-d3cf9124-50c5-4c4d-9ec2-b04492267b06 admin admin] Calling method '>' {{(pid=103452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:34:52.009231 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: INFO nova.api.openstack.requestlog [None req-d3cf9124-50c5-4c4d-9ec2-b04492267b06 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001621 Jul 15 20:34:52.009615 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: [pid: 103452|app: 0|req: 37/75] 10.222.0.66 () {56 vars in 1074 bytes} [Fri Jul 15 20:34:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:34:52.199777 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG nova.api.openstack.wsgi [None req-f363a6f1-d32f-4ce8-bd79-f44187e4c35b admin admin] Calling method '>' {{(pid=103453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:34:52.200983 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 15 20:34:52.200983 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: warnings.warn(msg) Jul 15 20:34:52.202187 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG oslo_concurrency.lockutils [None req-f363a6f1-d32f-4ce8-bd79-f44187e4c35b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:34:52.202630 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG oslo_concurrency.lockutils [None req-f363a6f1-d32f-4ce8-bd79-f44187e4c35b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:34:52.203417 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG oslo_concurrency.lockutils [None req-f363a6f1-d32f-4ce8-bd79-f44187e4c35b admin admin] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:34:52.203848 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: DEBUG oslo_concurrency.lockutils [None req-f363a6f1-d32f-4ce8-bd79-f44187e4c35b admin admin] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:34:52.226351 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: INFO nova.api.openstack.requestlog [None req-f363a6f1-d32f-4ce8-bd79-f44187e4c35b admin admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.077715 Jul 15 20:34:52.226844 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: [pid: 103453|app: 0|req: 39/76] 10.222.0.66 () {60 vars in 1193 bytes} [Fri Jul 15 20:34:52 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:35:50.253364 dv-cinder-799871-35-iscsi devstack@n-api.service[103451]: Fri Jul 15 20:35:50 2022 - graceful shutdown triggered... Jul 15 20:35:50.253481 dv-cinder-799871-35-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 15 20:35:50.254297 dv-cinder-799871-35-iscsi devstack@n-api.service[103452]: Gracefully killing worker 1 (pid: 103452)... Jul 15 20:35:50.254663 dv-cinder-799871-35-iscsi devstack@n-api.service[103453]: Gracefully killing worker 2 (pid: 103453)... Jul 15 20:35:51.255673 dv-cinder-799871-35-iscsi devstack@n-api.service[103451]: worker 1 buried after 1 seconds Jul 15 20:35:51.255673 dv-cinder-799871-35-iscsi devstack@n-api.service[103451]: worker 2 buried after 1 seconds Jul 15 20:35:51.255673 dv-cinder-799871-35-iscsi devstack@n-api.service[103451]: goodbye to uWSGI. Jul 15 20:35:51.257573 dv-cinder-799871-35-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 15 20:35:51.258115 dv-cinder-799871-35-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 15 20:35:51.262236 dv-cinder-799871-35-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 15 20:35:51.275822 dv-cinder-799871-35-iscsi devstack@n-api.service[124413]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 15 20:35:51.278332 dv-cinder-799871-35-iscsi devstack@n-api.service[124413]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jul 15 20:35:51 2022] *** Jul 15 20:35:51.278600 dv-cinder-799871-35-iscsi devstack@n-api.service[124413]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 15 20:35:51.278600 dv-cinder-799871-35-iscsi devstack@n-api.service[124413]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 15 20:35:51.278600 dv-cinder-799871-35-iscsi devstack@n-api.service[124413]: nodename: dv-cinder-799871-35-iscsi Jul 15 20:35:51.278600 dv-cinder-799871-35-iscsi devstack@n-api.service[124413]: machine: x86_64 Jul 15 20:35:51.278600 dv-cinder-799871-35-iscsi devstack@n-api.service[124413]: clock source: unix Jul 15 20:35:51.278600 dv-cinder-799871-35-iscsi devstack@n-api.service[124413]: pcre jit disabled Jul 15 20:35:51.278600 dv-cinder-799871-35-iscsi devstack@n-api.service[124413]: detected number of CPU cores: 4 Jul 15 20:35:51.279167 dv-cinder-799871-35-iscsi devstack@n-api.service[124413]: current working directory: / Jul 15 20:35:51.279167 dv-cinder-799871-35-iscsi devstack@n-api.service[124413]: detected binary path: /usr/bin/uwsgi-core Jul 15 20:35:51.279167 dv-cinder-799871-35-iscsi devstack@n-api.service[124413]: your processes number limit is 47680 Jul 15 20:35:51.279167 dv-cinder-799871-35-iscsi devstack@n-api.service[124413]: your memory page size is 4096 bytes Jul 15 20:35:51.279167 dv-cinder-799871-35-iscsi devstack@n-api.service[124413]: detected max file descriptor number: 2048 Jul 15 20:35:51.279167 dv-cinder-799871-35-iscsi devstack@n-api.service[124413]: lock engine: pthread robust mutexes Jul 15 20:35:51.279167 dv-cinder-799871-35-iscsi devstack@n-api.service[124413]: thunder lock: enabled Jul 15 20:35:51.279167 dv-cinder-799871-35-iscsi devstack@n-api.service[124413]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 15 20:35:51.279804 dv-cinder-799871-35-iscsi devstack@n-api.service[124413]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 15 20:35:51.330512 dv-cinder-799871-35-iscsi devstack@n-api.service[124413]: Python main interpreter initialized at 0x560a2ca9a9c0 Jul 15 20:35:51.330512 dv-cinder-799871-35-iscsi devstack@n-api.service[124413]: python threads support enabled Jul 15 20:35:51.330512 dv-cinder-799871-35-iscsi devstack@n-api.service[124413]: your server socket listen backlog is limited to 100 connections Jul 15 20:35:51.330512 dv-cinder-799871-35-iscsi devstack@n-api.service[124413]: your mercy for graceful operations on workers is 90 seconds Jul 15 20:35:51.331016 dv-cinder-799871-35-iscsi devstack@n-api.service[124413]: mapped 403077 bytes (393 KB) for 2 cores Jul 15 20:35:51.331016 dv-cinder-799871-35-iscsi devstack@n-api.service[124413]: *** Operational MODE: preforking *** Jul 15 20:35:51.331227 dv-cinder-799871-35-iscsi devstack@n-api.service[124413]: *** uWSGI is running in multiple interpreter mode *** Jul 15 20:35:51.331227 dv-cinder-799871-35-iscsi devstack@n-api.service[124413]: spawned uWSGI master process (pid: 124413) Jul 15 20:35:51.331441 dv-cinder-799871-35-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 15 20:35:51.332053 dv-cinder-799871-35-iscsi devstack@n-api.service[124413]: spawned uWSGI worker 1 (pid: 124430, cores: 1) Jul 15 20:35:51.332431 dv-cinder-799871-35-iscsi devstack@n-api.service[124413]: spawned uWSGI worker 2 (pid: 124432, cores: 1) Jul 15 20:35:51.332587 dv-cinder-799871-35-iscsi devstack@n-api.service[124413]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 15 20:35:52.063581 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 15 20:35:52.207715 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 15 20:35:53.227589 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 15 20:35:53.227589 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: from cryptography.utils import int_from_bytes Jul 15 20:35:53.228269 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 15 20:35:53.228269 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: from cryptography.utils import int_from_bytes Jul 15 20:35:53.347801 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 15 20:35:53.347801 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: from cryptography.utils import int_from_bytes Jul 15 20:35:53.348512 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 15 20:35:53.348512 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: from cryptography.utils import int_from_bytes Jul 15 20:35:55.545863 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 15 20:35:55.546417 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 15 20:35:55.546642 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 15 20:35:55.547003 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 15 20:35:55.547263 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 15 20:35:55.547652 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.547975 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.548291 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.548704 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.548973 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.549286 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.549604 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.549922 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.550247 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.554051 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.554051 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.554051 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-799871-35-iscsi {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.554051 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.554051 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.554051 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.554051 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.554051 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.554646 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.554646 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.554646 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.554646 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.554916 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.556665 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.556665 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.556665 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.556665 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.556665 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.556665 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.557137 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.557217 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.557601 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-799871-35-iscsi {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.557914 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.558213 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.558536 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.558935 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.559244 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.559551 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.559871 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.560188 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.560511 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.560837 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.561156 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.561474 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.561786 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.562103 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.562393 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.562700 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.563028 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.563315 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.563620 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.563866 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.564177 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.564516 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.564836 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.565153 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.565402 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.565649 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.565965 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.566280 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.566585 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.566889 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.567192 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.567623 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.567989 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.568300 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.568699 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.569005 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.569325 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.569638 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.569960 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.570265 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.570580 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.570987 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.66 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.571238 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.66 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.571542 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.571881 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.572198 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.572568 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.572838 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.573155 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.573460 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.573765 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.574072 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.574388 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.574709 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.575010 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.575258 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.575557 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.576327 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.576327 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.576679 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.576830 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.577064 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.577361 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.577662 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.577965 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.578268 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.578572 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.578892 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.579170 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.579473 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.579773 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.580076 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.580412 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.580741 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.581045 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.581349 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.581651 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.581962 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.582268 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.582571 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.582875 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.583757 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.584069 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.584486 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.584815 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.585156 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.585432 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.585750 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.586049 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.586355 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.586669 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.586973 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.587277 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.587578 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.587879 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.588183 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.588504 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.588808 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.589102 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.589393 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.589709 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.590024 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.590330 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.590633 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.590935 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.591251 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.591590 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.591920 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.592338 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.592617 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.592952 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.593283 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.593603 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.593916 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.594230 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.594558 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.594868 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.595180 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.595489 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.595805 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.596123 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.596471 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.596792 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.597234 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.597424 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.597722 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.598038 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.598366 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.598844 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.599796 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.600140 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.600508 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.600826 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.601153 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.601477 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.601790 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.602102 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.602451 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.602731 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.603070 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.603382 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.603743 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.604066 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.604379 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.604780 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.605092 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.605404 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.605741 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.606056 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.606369 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.606678 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.606993 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.607304 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.607614 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.607923 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.608225 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.608554 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.608911 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.609162 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.609467 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.609785 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.610095 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.610398 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.610732 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.611034 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.611342 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.611652 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.611959 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.612263 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.612602 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.612902 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.613206 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.613527 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.613836 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.614141 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.614535 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.614833 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.615136 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.615448 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.615757 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.616065 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.616377 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.616707 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.617030 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.617343 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.617651 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.617985 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.618317 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.618621 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.619117 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.619287 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.619607 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.619929 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.620193 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.620517 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.620808 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.621102 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.621408 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.621710 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.622015 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.622318 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.622621 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.622921 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.623240 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.623546 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.623846 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.624147 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.624474 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.624822 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.625127 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.625469 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.625804 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.626121 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.626445 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.626756 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.627072 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.627382 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.627694 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.628003 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.628311 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.628654 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.628964 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.629283 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.629589 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.630081 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.630402 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.630733 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.631034 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.631345 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.631685 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.632019 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.632336 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.632696 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.633101 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.633296 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.633596 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.633906 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.634215 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.634532 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.634852 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.635161 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.635476 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.635785 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.636110 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.636459 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.636756 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.637060 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.637373 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.637703 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.638036 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.638346 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.638655 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.638976 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.639369 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.639591 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.639900 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.640246 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.640548 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.640832 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.641193 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.641429 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.641738 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.642042 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.642358 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.642666 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.642970 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.643273 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.643582 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.643902 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.644209 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.644556 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.644903 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.645179 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.645496 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.646419 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.646727 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.647030 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.647335 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.647639 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.647981 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.648290 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.648618 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.648936 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.649257 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.649570 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.649885 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.650302 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.650499 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.650874 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.651112 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.651416 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.651721 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.652028 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.652336 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.652670 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.652998 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.653304 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.653615 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.653920 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.654221 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.654530 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.654847 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.655436 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.655767 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.656081 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.656417 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.656740 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.657059 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.657387 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.657713 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.658048 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.658354 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.658662 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.658966 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.659269 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.659645 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.659875 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.660179 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.660521 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.660839 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.661185 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.661539 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.661843 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.662243 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.662566 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.662873 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.663186 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.663491 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.663813 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.664124 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.664447 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.664759 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.665069 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.665412 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.665718 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.666055 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.666382 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.666723 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.667029 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.667580 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.667913 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.668218 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.668553 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.668860 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.669170 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.669478 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.669782 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.670087 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.670574 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.670750 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.671345 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.671345 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.671774 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.671916 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.672184 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.672518 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.672799 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.673104 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.673408 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.673714 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.674007 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.674392 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.674638 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.674940 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.675382 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.675763 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.675943 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.676239 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.676573 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.677448 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.677778 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.678099 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.678519 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.678828 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.679139 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.679444 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.679771 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.680061 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.680378 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.680718 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.681016 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.681520 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.681689 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.681919 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.682240 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.682524 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.682825 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.683126 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.683439 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.683722 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.684019 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.684338 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.684668 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.684971 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.685275 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.685584 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.685928 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.686229 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.686585 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.686890 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.687205 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.687523 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.687832 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.688138 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.688490 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.688776 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.689089 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.689397 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.689707 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.690082 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.690321 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.690626 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.690923 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.691226 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.691546 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.691865 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.692186 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.692746 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.693163 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.693561 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.693833 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.694092 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.694402 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.695020 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.695334 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.695653 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.695998 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.696273 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.696673 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.696986 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.697315 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.697599 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.697922 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.698229 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.698534 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.698841 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.699143 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.699449 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.700321 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.700321 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.700680 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.700839 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.701073 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.701385 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.701697 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.702036 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.702320 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.702625 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.703040 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.703444 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.703643 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.704129 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.704291 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.704559 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.704868 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.705193 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.705503 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.705808 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.706110 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.706431 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.706734 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.707054 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.707466 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.707776 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.708132 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.708570 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.708867 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.709178 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.709500 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.709821 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.710143 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.710447 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.710757 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.711115 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.711385 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.711754 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.712047 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.712326 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.712651 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.712972 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.713293 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.713607 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.714084 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.714961 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.714961 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.714961 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.715730 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.715730 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.716127 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.716127 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.716565 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.716753 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.717056 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.717375 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.717678 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.717986 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.718292 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.718599 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.718902 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.719203 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.719522 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.719823 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.720142 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.720502 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.720798 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.721115 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.721417 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.721734 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.722040 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.722341 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.722643 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.722946 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.723288 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.723592 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.725189 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.725189 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.725189 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.725646 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.725796 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.726045 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.726359 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.726679 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.727000 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.727305 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.727608 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.727915 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.728219 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.731181 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.731181 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.731181 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.731181 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.731181 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.731181 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.731181 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.731181 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.733341 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.733341 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.733341 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.733341 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.733341 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.733341 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.733341 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.733341 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.734861 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.734861 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.734861 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.734861 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.734861 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.734861 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.735856 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.735856 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.735856 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.736439 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.736439 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.736840 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.737006 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.737304 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.737615 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.737932 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.738496 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.738823 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.739137 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.739573 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.739889 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.740204 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.740537 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.740853 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.741198 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.741513 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.741822 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.742149 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.742470 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.742794 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.743214 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.743439 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.743752 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.744063 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.744374 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.744747 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.745060 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.745365 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.745777 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.745978 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.746300 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.746609 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.746918 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.747227 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.747537 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.747844 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.748151 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.748346 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 15 20:35:55.748881 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.749039 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 15 20:35:55.749190 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.749190 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.749551 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 15 20:35:55.750254 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.750452 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 15 20:35:55.750618 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.750781 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 15 20:35:55.751032 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.751192 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.751353 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.751747 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.751906 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.752073 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.752239 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.752435 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.752596 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.752758 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.752910 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.753075 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.753520 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.753688 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.753949 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.754108 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.754276 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.754430 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.754593 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.755482 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.755674 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.755674 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.755996 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.756269 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.756545 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-799871-35-iscsi {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.756705 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.756869 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.757143 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.757368 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.757525 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.757677 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.757841 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.757992 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.758153 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.758304 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.758456 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.759218 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.759392 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.759555 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.759718 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.759871 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.760051 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.760219 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.760379 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.760593 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.760754 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.760915 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.761193 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.761361 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.761523 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.761692 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.761845 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.761845 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.762143 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.762294 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.762515 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.762690 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.762902 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.763060 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.763229 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.763624 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.763848 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.764056 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.764542 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-799871-35-iscsi {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.764716 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.765101 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.765398 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.765798 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.765972 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.765972 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.766312 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.766704 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.766815 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.766905 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.766992 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.767077 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.767233 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.767330 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.767330 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.767520 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.767646 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.767759 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.767869 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.767981 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.768097 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.768193 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.768280 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.768372 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.768507 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.768507 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.768680 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.768766 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.768861 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.768948 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.769041 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.769137 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.769230 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.769322 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.769322 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.769484 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.769576 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.769671 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.769764 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.769850 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.769934 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.770018 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.770101 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.770199 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.770285 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.770285 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.770448 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.770555 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.771279 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.771433 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.771526 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.771619 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.771712 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.771712 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.771887 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.771981 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.772075 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.772160 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.772245 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.772343 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.772513 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.772619 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.772707 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.772798 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.772798 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.772969 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.773064 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.773156 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.773241 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.773332 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.773442 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.773626 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.773788 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.773919 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.774102 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.774218 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.774427 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.774544 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.774746 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.774840 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.775075 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.775186 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.775384 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.775488 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.775696 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.775804 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.776006 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.776108 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.66 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.776318 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.776453 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.66 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.776651 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.776749 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.776957 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.777063 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.777287 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.777387 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.777577 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.777685 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.777884 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.777984 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.778191 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.778293 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.778496 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.778596 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.778802 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.778904 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.779107 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.779205 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.779416 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.779515 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.779752 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.779852 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.780058 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.780158 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.780310 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.780480 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.780642 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.780750 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.780952 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.781051 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.781274 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.781389 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.781584 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.781695 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.781887 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.781984 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.782191 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.782282 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.782491 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.782619 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.782798 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.782890 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.783105 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.783204 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.783406 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.783504 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.783713 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.783904 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.784047 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.784192 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.784347 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.784484 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.784643 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.784745 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.784948 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.785058 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.785252 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.785414 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.785577 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.785678 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.785899 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.786001 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.786269 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.786372 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.786613 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.786724 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.786946 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.787072 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.787293 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.787396 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.787620 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.787732 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.787927 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.788027 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.788235 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.788382 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.788563 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.788671 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.788868 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.788963 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.789199 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.789385 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.789517 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.789780 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.789913 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.790122 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.790435 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.790786 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.790900 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.791118 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.791288 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.791439 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.791588 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.791846 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.792003 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.792163 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.792313 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.792753 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.792912 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.793062 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.793200 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.793341 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.793503 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.793816 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.794142 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.794469 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.794797 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.795117 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.795378 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.795527 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.795716 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.795816 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.796033 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.796132 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.796350 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.796458 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.796684 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.796790 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.796996 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.797165 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.797378 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.797544 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.797648 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.797735 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.797908 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.798002 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 20:35:55.798248 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.798353 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.798585 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.798678 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.798905 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.798998 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.799231 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.799338 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.799546 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.799684 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.799870 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.800025 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.800180 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.800361 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.801317 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.801492 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.801611 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.801724 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.801948 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.802098 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.802259 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.802418 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.802515 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.802602 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.802703 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.802791 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.802884 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.802970 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.803062 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.803156 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.803256 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.803344 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.803459 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.803586 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.803773 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.803954 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.804108 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.804318 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.804498 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.804655 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.804751 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.804978 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.805080 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.805354 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.805445 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.805680 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.805783 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.805998 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.806093 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.806309 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.806410 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.806641 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.806743 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.806953 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.807047 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.807271 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.807367 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.807581 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.807680 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.807894 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.807998 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.808206 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.808329 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.808550 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.808675 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.808881 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.808979 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.809166 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.809269 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.809486 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.809596 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.809803 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.809898 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.810115 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.810215 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.810432 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.810534 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.810741 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.810840 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.811081 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.811186 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.811367 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.811461 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.811707 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.811798 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.812022 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.812186 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.812346 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.812480 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.812679 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.812783 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.813003 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.813097 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.813312 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.813404 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.813624 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.813779 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.813940 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 15 20:35:55.814061 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.814281 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.814519 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.814828 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.815138 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.815446 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.815770 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.816098 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.816498 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.816797 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.817110 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.818038 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.818345 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.818662 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.818979 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.819294 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.819607 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.819918 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.820248 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.820618 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.820955 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.821282 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.821616 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.821927 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.822276 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.822626 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.822940 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.823277 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.823634 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.823961 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.824277 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.824621 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.824982 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.825315 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.825649 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.825980 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.826305 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.826627 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.826959 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.827270 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.827579 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.827883 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.828237 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.828613 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.828955 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.829309 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.829617 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.829925 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.830279 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.830612 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.830921 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.831230 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.831538 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.831844 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.832208 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.832533 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.832883 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.833797 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.834172 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.834665 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.834988 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.835310 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.835690 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.836010 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.836325 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.836699 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.837025 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.837371 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.837696 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.838013 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.838351 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.838698 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.839052 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.839362 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.839702 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.840051 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.840414 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.840738 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.841069 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.841385 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.841703 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.842014 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.842328 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.842702 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.843018 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.843339 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.843653 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.843974 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.844285 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.844684 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.845001 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.845322 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.845631 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.845948 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.846284 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.846618 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.846928 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.847243 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.847568 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.847884 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.848194 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.848538 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.849366 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.849687 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.850001 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.850320 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.850633 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.850944 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.851254 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.851570 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.851880 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.852187 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.852582 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.852832 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.853163 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.853594 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.853927 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.854253 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.854560 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.854869 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.855194 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.855506 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.855813 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.856122 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.856461 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.856816 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.857129 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.857437 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.857758 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.858085 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.858396 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.858723 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.859039 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.859366 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.859692 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.860009 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.860320 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.860664 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.860979 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.861292 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.861636 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.861934 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.862247 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.862562 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.862877 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.863183 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.863496 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.863819 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.864520 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.864882 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.865231 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.865598 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.865920 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.866243 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.866608 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.866992 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.867383 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.867720 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.868079 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.868407 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.868756 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.869076 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.869414 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.869779 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.870065 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.870377 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.870690 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.870997 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.871304 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.871611 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.871932 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.872238 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.872586 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.872892 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.873226 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.873537 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.873846 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.874156 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.874462 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.874809 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.875152 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.875501 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.875834 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.876179 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.876510 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.876820 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.877171 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.877441 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.877748 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.878052 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.878363 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.878669 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.878973 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.879290 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.879599 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.880474 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.880780 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.881092 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.881397 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.881830 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.882184 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.882543 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.882852 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.883161 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.883499 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.883835 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.884145 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.884497 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.884807 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.885128 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.885435 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.885768 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.886075 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.886385 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.886694 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.887002 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.887337 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.887649 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.887955 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.888290 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.888628 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.888984 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.889296 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.889607 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.889933 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.890254 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.890586 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.890896 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.891202 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.891510 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.891818 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.892129 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.892455 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.892763 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.893067 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.893371 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.893677 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.894005 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.894346 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.894652 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.894960 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.895306 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.895862 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.896368 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.896826 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.897147 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.897489 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.897844 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.898186 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.898505 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.898871 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.899186 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.899535 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.899850 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.900167 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.900502 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.900814 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.901147 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.901462 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.901773 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.902098 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.902424 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.902750 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.903057 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.903369 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.903681 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.903990 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.904302 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.904661 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.904972 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.905288 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.905602 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.905915 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.906254 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.906562 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.906902 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.907216 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.907570 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.907920 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.908236 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.908574 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.908886 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.909234 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.909578 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.909913 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.910386 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.910701 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.911014 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.912219 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.912584 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.912976 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.913307 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.913625 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.913935 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.914361 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.914676 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.915022 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.915337 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.915676 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.916012 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.916329 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.916688 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.917021 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.917575 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.917919 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.918272 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.918604 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.918933 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.919362 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.919722 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.920055 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.920516 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.920863 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.921176 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.921526 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.921879 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.922229 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.922581 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.922918 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.923253 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.923583 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.923914 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.924228 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.924574 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.924885 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.925214 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.925542 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.925861 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.926189 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.926611 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.927147 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.927586 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.928140 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.928638 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.928955 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.929452 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.929975 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.930454 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.930807 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.931143 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.931486 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.931835 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.932184 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.932548 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.932886 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.933248 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.933582 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.933896 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.934224 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.934546 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.934875 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.935219 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.935531 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.935858 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.936170 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.936503 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.936817 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.937124 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.937504 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.937813 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.938163 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.938518 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.938878 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.939218 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.939586 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.939919 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.940238 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.940604 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.940935 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.941243 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.941548 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.941859 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.942165 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.943018 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.943331 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.943636 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.943946 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.944250 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.944582 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.944911 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.945217 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.945540 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.945860 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.946161 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.946469 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.946775 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.947121 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.947428 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.947765 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.948085 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.948423 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.948785 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.949098 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.949424 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.949773 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.950095 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.950479 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.950822 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.951141 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.951481 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.951797 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.952135 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.952505 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.952825 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.953174 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.953769 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.954106 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.954551 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.954870 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.955217 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.955561 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.955896 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.956214 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.956552 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.956867 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.957177 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.957721 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.958111 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.958455 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.958795 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.959119 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.959439 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.959787 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.960880 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.961360 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.961717 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.962056 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.962398 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.962738 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.963075 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.963404 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.963732 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.964065 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.964462 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO dbcounter [None req-a655e769-344d-45d3-822c-df115b611557 None None] Registered counter for database nova_api Jul 15 20:35:55.964591 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.964909 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.965234 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.965560 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.965888 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.966633 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.966995 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.967331 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.967662 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.968130 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.968499 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.969070 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.969397 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.969745 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.970085 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.970423 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.970757 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.971083 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.971420 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.971735 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.972049 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.972381 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.972706 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.973017 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.973345 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.974264 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.974850 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.975371 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.975803 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.976496 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.976935 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.977344 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.977705 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.978170 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.978508 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.978926 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.979283 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.980796 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.980796 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.980796 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.981051 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.981284 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.981599 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.981917 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.982252 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.982545 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.982871 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.983170 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.983498 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.983810 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.984128 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.984541 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.984864 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.985177 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.985357 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_db.sqlalchemy.engines [None req-a655e769-344d-45d3-822c-df115b611557 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124432) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 20:35:55.985483 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.985796 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.986087 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.986408 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.986717 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.987032 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.987359 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.987656 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.987963 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.988327 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.988703 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.989019 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.989410 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.989953 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.990288 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.990607 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.990939 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.991257 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.991578 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.991935 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.992257 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.992491 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writer thread running {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 20:35:55.992854 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.993195 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.993531 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.993861 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.994199 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.994510 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.994819 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.995129 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.995457 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.995772 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.996086 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.996415 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.996735 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.997046 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.997464 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.997779 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.998093 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.998407 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.998719 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.999031 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.999341 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.999656 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:55.999976 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.000323 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.000665 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.000989 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.001306 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.001628 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.001942 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.002253 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.002567 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.002877 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.003194 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.003548 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.003841 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.004147 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.004601 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.005434 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.005769 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.006093 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.006404 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.006728 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.007055 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.007368 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.007688 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.008002 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.008333 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.008700 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.009033 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.009364 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.009677 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.009987 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.010294 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.010607 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.010948 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.011239 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.011546 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.011857 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.012169 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.012499 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.012807 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.013112 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.013417 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.013725 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.014024 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.014331 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.014636 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.014942 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.015247 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.015553 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.015865 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.016169 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.016497 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.016804 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.017108 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.017414 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.017748 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.018087 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.018404 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.018731 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.019045 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.019371 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.019683 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.020009 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.020338 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.021294 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.021613 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.021955 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.022269 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.022584 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.022899 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.023214 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.023526 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.023840 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.024172 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.024533 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.024847 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.025180 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.025499 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.025822 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.026140 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.026451 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.026784 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.027096 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.027410 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.027722 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.028035 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.028349 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.028785 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.029019 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.029332 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.029650 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.029968 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.030298 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.030627 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.030940 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.031267 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.031605 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.031951 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.032266 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.032638 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.032969 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.033288 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.033600 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.033909 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 20:35:56.034153 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 15 20:35:56.048741 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.context [None req-a655e769-344d-45d3-822c-df115b611557 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5eaba057-d4d0-4606-828e-5e21cf3c2999(cell1) {{(pid=124432) load_cells /opt/stack/nova/nova/context.py:464}} Jul 15 20:35:56.053251 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a655e769-344d-45d3-822c-df115b611557 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:35:56.054797 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a655e769-344d-45d3-822c-df115b611557 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:35:56.055590 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a655e769-344d-45d3-822c-df115b611557 None None] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:35:56.057577 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a655e769-344d-45d3-822c-df115b611557 None None] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:35:56.059544 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO dbcounter [None req-a655e769-344d-45d3-822c-df115b611557 None None] Registered counter for database nova_cell0 Jul 15 20:35:56.063524 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO dbcounter [None req-a655e769-344d-45d3-822c-df115b611557 None None] Registered counter for database nova_cell1 Jul 15 20:35:56.071839 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_db.sqlalchemy.engines [None req-a655e769-344d-45d3-822c-df115b611557 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124432) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 20:35:56.072659 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_db.sqlalchemy.engines [None req-a655e769-344d-45d3-822c-df115b611557 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124432) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 20:35:56.078860 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writer thread running {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 20:35:56.080319 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writer thread running {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 20:35:56.188265 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO dbcounter [None req-bd442624-deb5-4329-ab30-f6b06c3243aa None None] Registered counter for database nova_api Jul 15 20:35:56.210882 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_db.sqlalchemy.engines [None req-bd442624-deb5-4329-ab30-f6b06c3243aa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124430) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 20:35:56.218059 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writer thread running {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 20:35:56.228860 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO dbcounter [None req-a655e769-344d-45d3-822c-df115b611557 None None] Registered counter for database nova_cell0 Jul 15 20:35:56.238048 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_db.sqlalchemy.engines [None req-a655e769-344d-45d3-822c-df115b611557 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124432) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 20:35:56.242330 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writer thread running {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 20:35:56.279508 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.context [None req-bd442624-deb5-4329-ab30-f6b06c3243aa None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5eaba057-d4d0-4606-828e-5e21cf3c2999(cell1) {{(pid=124430) load_cells /opt/stack/nova/nova/context.py:464}} Jul 15 20:35:56.284069 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-bd442624-deb5-4329-ab30-f6b06c3243aa None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:35:56.285965 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-bd442624-deb5-4329-ab30-f6b06c3243aa None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:35:56.287258 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-bd442624-deb5-4329-ab30-f6b06c3243aa None None] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:35:56.289729 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-bd442624-deb5-4329-ab30-f6b06c3243aa None None] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:35:56.291792 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO dbcounter [None req-bd442624-deb5-4329-ab30-f6b06c3243aa None None] Registered counter for database nova_cell0 Jul 15 20:35:56.296250 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO dbcounter [None req-bd442624-deb5-4329-ab30-f6b06c3243aa None None] Registered counter for database nova_cell1 Jul 15 20:35:56.306304 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_db.sqlalchemy.engines [None req-bd442624-deb5-4329-ab30-f6b06c3243aa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124430) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 20:35:56.310641 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_db.sqlalchemy.engines [None req-bd442624-deb5-4329-ab30-f6b06c3243aa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124430) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 20:35:56.320804 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writer thread running {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 20:35:56.322466 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writer thread running {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 20:35:56.475835 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO dbcounter [None req-bd442624-deb5-4329-ab30-f6b06c3243aa None None] Registered counter for database nova_cell0 Jul 15 20:35:56.484967 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_db.sqlalchemy.engines [None req-bd442624-deb5-4329-ab30-f6b06c3243aa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124430) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 20:35:56.489711 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writer thread running {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 20:35:56.561962 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: WARNING keystonemiddleware.auth_token [None req-a655e769-344d-45d3-822c-df115b611557 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 15 20:35:56.571248 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: WARNING keystonemiddleware.auth_token [None req-a655e769-344d-45d3-822c-df115b611557 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 15 20:35:56.836572 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: WARNING keystonemiddleware.auth_token [None req-bd442624-deb5-4329-ab30-f6b06c3243aa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 15 20:35:56.844689 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: WARNING keystonemiddleware.auth_token [None req-bd442624-deb5-4329-ab30-f6b06c3243aa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 15 20:35:56.924847 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: WARNING keystonemiddleware.auth_token [None req-a655e769-344d-45d3-822c-df115b611557 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 15 20:35:56.931782 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: WARNING keystonemiddleware.auth_token [None req-a655e769-344d-45d3-822c-df115b611557 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 15 20:35:56.937173 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x560a2ca9a9c0 pid: 124432 (default app) Jul 15 20:35:57.213902 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: WARNING keystonemiddleware.auth_token [None req-bd442624-deb5-4329-ab30-f6b06c3243aa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 15 20:35:57.219946 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: WARNING keystonemiddleware.auth_token [None req-bd442624-deb5-4329-ab30-f6b06c3243aa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 15 20:35:57.225927 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560a2ca9a9c0 pid: 124430 (default app) Jul 15 20:36:38.301046 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_api:SELECT=3 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:38.302745 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell0:SELECT=3 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:38.303888 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell1:SELECT=3 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:38.304899 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell0:SELECT=3 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:39.874674 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-6f29775d-cbcb-4bd8-9123-1326cb2ddfd1 tempest-VolumesGetTestJSON-1550390811 tempest-VolumesGetTestJSON-1550390811-project] Action: 'create', calling method: .version_select at 0x7ff519a43820>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1820035614", "metadata": {"Type": "work"}}} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:36:42.130944 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-6f29775d-cbcb-4bd8-9123-1326cb2ddfd1 tempest-VolumesGetTestJSON-1550390811 tempest-VolumesGetTestJSON-1550390811-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.839857 Jul 15 20:36:42.144556 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 1/1] 10.222.0.66 () {60 vars in 1155 bytes} [Fri Jul 15 20:36:38 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3855 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 15 20:36:42.749578 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-a10896a4-505d-46b9-ae6a-80b754d12cc7 tempest-VolumesGetTestJSON-1550390811 tempest-VolumesGetTestJSON-1550390811-project] Calling method '.version_select at 0x7ff519a3d3a0>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:36:42.846357 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_api:SELECT=3 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:42.847196 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_cell0:SELECT=3 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:42.886556 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_cell1:SELECT=3 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:42.886556 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_cell0:SELECT=3 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:36:44.507605 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-a10896a4-505d-46b9-ae6a-80b754d12cc7 tempest-VolumesGetTestJSON-1550390811 tempest-VolumesGetTestJSON-1550390811-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/e4282542-194b-4dcc-87e6-e408d5937f5c" status: 200 len: 354 microversion: 2.1 time: 2.366388 Jul 15 20:36:44.515123 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 1/2] 10.222.0.66 () {58 vars in 1244 bytes} [Fri Jul 15 20:36:42 2022] GET /compute/v2.1/os-volumes/e4282542-194b-4dcc-87e6-e408d5937f5c => generated 354 bytes in 2376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:36:44.521064 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-817b96a6-d304-4486-92dd-9834b711f4c7 tempest-VolumesGetTestJSON-1550390811 tempest-VolumesGetTestJSON-1550390811-project] Calling method '.version_select at 0x7ff51990e670>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:36:44.627198 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-817b96a6-d304-4486-92dd-9834b711f4c7 tempest-VolumesGetTestJSON-1550390811 tempest-VolumesGetTestJSON-1550390811-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/e4282542-194b-4dcc-87e6-e408d5937f5c" status: 200 len: 354 microversion: 2.1 time: 0.110591 Jul 15 20:36:44.628110 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 2/3] 10.222.0.66 () {58 vars in 1244 bytes} [Fri Jul 15 20:36:44 2022] GET /compute/v2.1/os-volumes/e4282542-194b-4dcc-87e6-e408d5937f5c => generated 354 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:36:44.648134 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-3a5ca9a1-5122-4810-bc2c-299cb5b35d5f tempest-VolumesGetTestJSON-1550390811 tempest-VolumesGetTestJSON-1550390811-project] Calling method '.version_select at 0x7ff5199038b0>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:36:44.782502 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-3a5ca9a1-5122-4810-bc2c-299cb5b35d5f tempest-VolumesGetTestJSON-1550390811 tempest-VolumesGetTestJSON-1550390811-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/e4282542-194b-4dcc-87e6-e408d5937f5c" status: 202 len: 0 microversion: 2.1 time: 0.141298 Jul 15 20:36:44.783444 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 2/4] 10.222.0.66 () {58 vars in 1247 bytes} [Fri Jul 15 20:36:44 2022] DELETE /compute/v2.1/os-volumes/e4282542-194b-4dcc-87e6-e408d5937f5c => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 20:36:44.794195 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-1b022161-3a79-4c7f-a6dc-8d97738df49e tempest-VolumesGetTestJSON-1550390811 tempest-VolumesGetTestJSON-1550390811-project] Calling method '.version_select at 0x7ff51990e9d0>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:36:44.918111 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-1b022161-3a79-4c7f-a6dc-8d97738df49e tempest-VolumesGetTestJSON-1550390811 tempest-VolumesGetTestJSON-1550390811-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/e4282542-194b-4dcc-87e6-e408d5937f5c" status: 200 len: 353 microversion: 2.1 time: 0.129988 Jul 15 20:36:44.919029 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 3/5] 10.222.0.66 () {58 vars in 1244 bytes} [Fri Jul 15 20:36:44 2022] GET /compute/v2.1/os-volumes/e4282542-194b-4dcc-87e6-e408d5937f5c => generated 353 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:36:45.933814 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-adbe9cff-6be1-4513-b197-23e13be74ebe tempest-VolumesGetTestJSON-1550390811 tempest-VolumesGetTestJSON-1550390811-project] Calling method '.version_select at 0x7ff519903940>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:36:45.989623 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.wsgi [None req-adbe9cff-6be1-4513-b197-23e13be74ebe tempest-VolumesGetTestJSON-1550390811 tempest-VolumesGetTestJSON-1550390811-project] HTTP exception thrown: Volume e4282542-194b-4dcc-87e6-e408d5937f5c could not be found. Jul 15 20:36:45.993786 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-adbe9cff-6be1-4513-b197-23e13be74ebe tempest-VolumesGetTestJSON-1550390811 tempest-VolumesGetTestJSON-1550390811-project] Request method failure captured: Jul 15 20:36:45.993786 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: request: GET /compute/v2.1/os-volumes/e4282542-194b-4dcc-87e6-e408d5937f5c HTTP/1.1 Jul 15 20:36:45.993786 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Accept: application/json Jul 15 20:36:45.993786 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Accept-Encoding: identity Jul 15 20:36:45.993786 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Connection: close Jul 15 20:36:45.993786 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Content-Length: 0 Jul 15 20:36:45.993786 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Content-Type: application/json Jul 15 20:36:45.993786 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Host: 10.222.0.66 Jul 15 20:36:45.993786 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Openstack-System-Scope: None Jul 15 20:36:45.993786 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: User-Agent: python-urllib3/1.26.9 Jul 15 20:36:45.993786 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Auth-Token: gAAAAABi0c_WKQiqvIdreY-nKqeIaFG4WNNnqXhk7RP1Xnu_pqCph3Qib7MVSO-ORhMuIIB4WHWwaJKHM8iEH56h_duKlFDv3PhnWW8qDMppcoNUo8QKMZA5PpPqOjzaHW-89nY_iKCdsf1QiDvIF93M1Vb405mjPQL6xDTg7a15ubFbmJSKrAw Jul 15 20:36:45.993786 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Domain-Id: None Jul 15 20:36:45.993786 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Domain-Name: None Jul 15 20:36:45.993786 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Identity-Status: Confirmed Jul 15 20:36:45.993786 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Is-Admin-Project: True Jul 15 20:36:45.993786 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Domain-Id: default Jul 15 20:36:45.993786 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Domain-Name: Default Jul 15 20:36:45.993786 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Id: c1020584fa404da1a9ad11ead78d638c Jul 15 20:36:45.993786 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Name: tempest-VolumesGetTestJSON-1550390811 Jul 15 20:36:45.993786 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Role: member,reader Jul 15 20:36:45.993786 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Roles: member,reader Jul 15 20:36:45.994944 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c1020584fa404da1a9ad11ead78d638c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_c1020584fa404da1a9ad11ead78d638c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c1020584fa404da1a9ad11ead78d638c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/c1020584fa404da1a9ad11ead78d638c"}]}] Jul 15 20:36:45.994944 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant: tempest-VolumesGetTestJSON-1550390811 Jul 15 20:36:45.994944 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant-Id: c1020584fa404da1a9ad11ead78d638c Jul 15 20:36:45.994944 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant-Name: tempest-VolumesGetTestJSON-1550390811 Jul 15 20:36:45.994944 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User: tempest-VolumesGetTestJSON-1550390811-project Jul 15 20:36:45.994944 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Domain-Id: default Jul 15 20:36:45.994944 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Domain-Name: Default Jul 15 20:36:45.994944 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Id: 0252063927c6497d891859b0f6d907e3 Jul 15 20:36:45.994944 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Name: tempest-VolumesGetTestJSON-1550390811-project Jul 15 20:36:45.994944 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: method: Jul 15 20:36:45.994944 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: exception: Volume e4282542-194b-4dcc-87e6-e408d5937f5c could not be found. Jul 15 20:36:45.994944 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: action_args: {'id': 'e4282542-194b-4dcc-87e6-e408d5937f5c'} Jul 15 20:36:45.994944 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 20:36:45.995603 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:36:45.995603 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 15 20:36:45.995603 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 15 20:36:45.995603 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 15 20:36:45.995603 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 15 20:36:45.995603 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 15 20:36:45.995603 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 15 20:36:45.995603 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 15 20:36:45.995603 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 15 20:36:45.995603 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 15 20:36:45.995603 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 15 20:36:45.995603 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 20:36:45.995603 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 20:36:45.995603 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 20:36:45.995603 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 20:36:45.995603 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e4282542-194b-4dcc-87e6-e408d5937f5c could not be found. (HTTP 404) (Request-ID: req-cb63a2bc-0441-409e-bd9e-8b7dcf161bf3) Jul 15 20:36:45.995603 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:36:45.995603 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:36:45.995603 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:36:45.997264 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:36:45.997264 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 15 20:36:45.997264 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 15 20:36:45.997264 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 15 20:36:45.997264 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 15 20:36:45.997264 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 15 20:36:45.997264 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 15 20:36:45.997264 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 15 20:36:45.997264 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 15 20:36:45.997264 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 15 20:36:45.997264 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 15 20:36:45.997264 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 15 20:36:45.997264 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 15 20:36:45.997264 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 15 20:36:45.997264 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 15 20:36:45.997264 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 15 20:36:45.997264 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 15 20:36:45.997264 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 15 20:36:45.997264 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 15 20:36:45.998115 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 20:36:45.998115 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 20:36:45.998115 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 20:36:45.998115 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 20:36:45.998115 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e4282542-194b-4dcc-87e6-e408d5937f5c could not be found. Jul 15 20:36:45.998115 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:36:45.998115 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:36:45.998115 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:36:45.998115 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:36:45.998115 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:36:45.998115 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:36:45.998115 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 20:36:45.998115 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 20:36:45.998115 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 15 20:36:45.998115 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 15 20:36:45.998115 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 20:36:45.998115 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 20:36:45.998115 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 15 20:36:45.998115 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 20:36:46.000993 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e4282542-194b-4dcc-87e6-e408d5937f5c could not be found. Jul 15 20:36:46.000993 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:36:46.000993 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:36:46.000993 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:36:46.000993 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:36:46.000993 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:36:46.000993 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:36:46.000993 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 20:36:46.000993 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 20:36:46.000993 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e4282542-194b-4dcc-87e6-e408d5937f5c could not be found. Jul 15 20:36:46.000993 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:36:46.000993 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-adbe9cff-6be1-4513-b197-23e13be74ebe tempest-VolumesGetTestJSON-1550390811 tempest-VolumesGetTestJSON-1550390811-project] Returning 404 to user: Volume e4282542-194b-4dcc-87e6-e408d5937f5c could not be found. {{(pid=124430) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 20:36:46.000993 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-adbe9cff-6be1-4513-b197-23e13be74ebe tempest-VolumesGetTestJSON-1550390811 tempest-VolumesGetTestJSON-1550390811-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/e4282542-194b-4dcc-87e6-e408d5937f5c" status: 404 len: 109 microversion: 2.1 time: 0.066716 Jul 15 20:36:46.000993 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 3/6] 10.222.0.66 () {58 vars in 1244 bytes} [Fri Jul 15 20:36:45 2022] GET /compute/v2.1/os-volumes/e4282542-194b-4dcc-87e6-e408d5937f5c => generated 109 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 20:36:52.609093 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-0e75cdf1-7793-4bdb-964e-71bfce7b1457 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2022232247", "imageRef": "a759604a-67e3-4c79-b848-5d03d936d7a0", "flavorRef": "452", "networks": [{"uuid": "6a702e67-c349-4b28-9498-7c90e79bab9c"}]}} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:36:52.891440 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.network.neutron [None req-0e75cdf1-7793-4bdb-964e-71bfce7b1457 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] validate_networks() for [('6a702e67-c349-4b28-9498-7c90e79bab9c', None, None, None, None, None)] {{(pid=124432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 20:36:53.427052 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-8fb344b0-d5cf-421a-b99c-94897377a73b tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Action: 'create', calling method: .version_select at 0x7ff51a2953a0>, body: {"keypair": {"name": "tempest-keypair-971365333", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFlAdwi8jgi1zyyVp2NtHvSppCVj+2k+UO+NBeibe4k/qm8h/b+8pOk61/EFk8r+0EAQmMgA5VjRqiJf49LD4DT+UJBKIx9sQwiF/W8cVozWfqovC5yavYNcuEBOBkOJWg=="}} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:36:53.503317 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.quota [None req-8fb344b0-d5cf-421a-b99c-94897377a73b tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Getting quotas for project 78a593e163e74a7b9db61133e5c22035. Resources: {'key_pairs'} {{(pid=124430) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 20:36:53.515109 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.quota [None req-8fb344b0-d5cf-421a-b99c-94897377a73b tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Getting quotas for user c0b5962b37b2470099436609425f7423 and project 78a593e163e74a7b9db61133e5c22035. Resources: {'key_pairs'} {{(pid=124430) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 20:36:53.594110 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-8fb344b0-d5cf-421a-b99c-94897377a73b tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.707082 Jul 15 20:36:53.598493 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 4/7] 10.222.0.66 () {60 vars in 1158 bytes} [Fri Jul 15 20:36:52 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:36:55.685184 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-29dbfdf6-499d-41d7-9fe9-643636004dc9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1551958595", "imageRef": "a759604a-67e3-4c79-b848-5d03d936d7a0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:36:55.901659 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.network.neutron [None req-29dbfdf6-499d-41d7-9fe9-643636004dc9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] validate_networks() for [('dadb3a1f-a806-41dc-8315-352bd978366a', None, None, None, None, None)] {{(pid=124430) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 20:36:56.247473 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-0e75cdf1-7793-4bdb-964e-71bfce7b1457 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Flavor limits 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 20:36:56.247958 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-0e75cdf1-7793-4bdb-964e-71bfce7b1457 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Image limits 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 20:36:56.248354 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-0e75cdf1-7793-4bdb-964e-71bfce7b1457 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Flavor pref 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 20:36:56.251983 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-0e75cdf1-7793-4bdb-964e-71bfce7b1457 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Image pref 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 20:36:56.251983 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-0e75cdf1-7793-4bdb-964e-71bfce7b1457 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 20:36:56.295122 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0e75cdf1-7793-4bdb-964e-71bfce7b1457 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:36:56.297647 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0e75cdf1-7793-4bdb-964e-71bfce7b1457 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:36:56.304724 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0e75cdf1-7793-4bdb-964e-71bfce7b1457 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:36:56.305532 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0e75cdf1-7793-4bdb-964e-71bfce7b1457 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:36:56.423471 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-0e75cdf1-7793-4bdb-964e-71bfce7b1457 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Getting quotas for project d2f12afd420d4f6bad8e80207ea64d44. Resources: {'instances', 'ram', 'cores'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 20:36:56.469319 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-0e75cdf1-7793-4bdb-964e-71bfce7b1457 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Getting quotas for user 1f231f706d2f4d3e9070105bb5981cec and project d2f12afd420d4f6bad8e80207ea64d44. Resources: {'instances', 'ram', 'cores'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 20:36:56.523719 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-0e75cdf1-7793-4bdb-964e-71bfce7b1457 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Going to run 1 instances... {{(pid=124432) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 20:36:56.533053 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-0e75cdf1-7793-4bdb-964e-71bfce7b1457 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] [instance: 31e74255-0b4d-4c43-91ce-ffccffdc2188] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a759604a-67e3-4c79-b848-5d03d936d7a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 20:36:56.690418 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-0e75cdf1-7793-4bdb-964e-71bfce7b1457 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.052878 Jul 15 20:36:56.691089 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 4/8] 10.222.0.66 () {60 vars in 1146 bytes} [Fri Jul 15 20:36:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 5054 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 20:36:56.703583 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-3db432fe-c075-4ae1-8ba3-15f2bc786957 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:36:56.704440 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-3db432fe-c075-4ae1-8ba3-15f2bc786957 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] [instance: 31e74255-0b4d-4c43-91ce-ffccffdc2188] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:36:56.974349 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-3db432fe-c075-4ae1-8ba3-15f2bc786957 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f231f706d2f4d3e9070105bb5981cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f12afd420d4f6bad8e80207ea64d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:36:57.014540 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-3db432fe-c075-4ae1-8ba3-15f2bc786957 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] 10.222.0.66 "GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188" status: 200 len: 1215 microversion: 2.1 time: 0.315437 Jul 15 20:36:57.018874 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 5/9] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:36:56 2022] GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188 => generated 1215 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:36:57.643106 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-a96d558f-5ad7-463d-bb02-823e15b85880 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1137940491", "imageRef": "a759604a-67e3-4c79-b848-5d03d936d7a0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f64ae9a9-bcaf-4115-89a7-71a9ec023719"}], "security_groups": [{"name": "tempest-securitygroup--949828738"}], "key_name": "tempest-keypair-971365333", "user_data": "}} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:36:58.088178 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.network.neutron [None req-a96d558f-5ad7-463d-bb02-823e15b85880 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] validate_networks() for [('f64ae9a9-bcaf-4115-89a7-71a9ec023719', None, None, None, None, None)] {{(pid=124432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 20:36:58.671598 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.virt.hardware [None req-29dbfdf6-499d-41d7-9fe9-643636004dc9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Flavor limits 0:0:0 {{(pid=124430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 20:36:58.672084 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.virt.hardware [None req-29dbfdf6-499d-41d7-9fe9-643636004dc9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Image limits 0:0:0 {{(pid=124430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 20:36:58.672659 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.virt.hardware [None req-29dbfdf6-499d-41d7-9fe9-643636004dc9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Flavor pref 0:0:0 {{(pid=124430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 20:36:58.673199 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.virt.hardware [None req-29dbfdf6-499d-41d7-9fe9-643636004dc9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Image pref 0:0:0 {{(pid=124430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 20:36:58.673721 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.virt.hardware [None req-29dbfdf6-499d-41d7-9fe9-643636004dc9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 20:36:58.713531 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-29dbfdf6-499d-41d7-9fe9-643636004dc9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:36:58.715354 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-29dbfdf6-499d-41d7-9fe9-643636004dc9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:36:58.716331 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-29dbfdf6-499d-41d7-9fe9-643636004dc9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:36:58.718617 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-29dbfdf6-499d-41d7-9fe9-643636004dc9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:36:58.817519 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.quota [None req-29dbfdf6-499d-41d7-9fe9-643636004dc9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Getting quotas for project 0395d91380b34e968d7e39be3bc88b0f. Resources: {'instances', 'ram', 'cores'} {{(pid=124430) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 20:36:58.835690 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.quota [None req-29dbfdf6-499d-41d7-9fe9-643636004dc9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Getting quotas for user e13d5d7068e348248387b512c55dec5e and project 0395d91380b34e968d7e39be3bc88b0f. Resources: {'instances', 'ram', 'cores'} {{(pid=124430) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 20:36:58.895013 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-29dbfdf6-499d-41d7-9fe9-643636004dc9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Going to run 1 instances... {{(pid=124430) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 20:36:58.898932 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-29dbfdf6-499d-41d7-9fe9-643636004dc9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 48c34b54-0234-4763-a6c1-f73c3c075277] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a759604a-67e3-4c79-b848-5d03d936d7a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124430) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 20:36:59.059086 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-29dbfdf6-499d-41d7-9fe9-643636004dc9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.329603 Jul 15 20:36:59.059729 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 5/10] 10.222.0.66 () {60 vars in 1146 bytes} [Fri Jul 15 20:36:54 2022] POST /compute/v2.1/servers => generated 383 bytes in 4331 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 20:36:59.067774 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-3460e396-3ed0-4201-84ef-11bab2a29699 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:36:59.069771 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-3460e396-3ed0-4201-84ef-11bab2a29699 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] [instance: 31e74255-0b4d-4c43-91ce-ffccffdc2188] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:36:59.097327 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-3460e396-3ed0-4201-84ef-11bab2a29699 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:36:59.102530 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-3460e396-3ed0-4201-84ef-11bab2a29699 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:36:59.104571 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-3460e396-3ed0-4201-84ef-11bab2a29699 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:36:59.105625 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-3460e396-3ed0-4201-84ef-11bab2a29699 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:36:59.494888 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-a96d558f-5ad7-463d-bb02-823e15b85880 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Flavor limits 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 20:36:59.495520 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-a96d558f-5ad7-463d-bb02-823e15b85880 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Image limits 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 20:36:59.496022 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-a96d558f-5ad7-463d-bb02-823e15b85880 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Flavor pref 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 20:36:59.496714 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-a96d558f-5ad7-463d-bb02-823e15b85880 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Image pref 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 20:36:59.497069 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-a96d558f-5ad7-463d-bb02-823e15b85880 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 20:36:59.529549 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a96d558f-5ad7-463d-bb02-823e15b85880 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:36:59.531473 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a96d558f-5ad7-463d-bb02-823e15b85880 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:36:59.538485 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a96d558f-5ad7-463d-bb02-823e15b85880 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:36:59.544041 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a96d558f-5ad7-463d-bb02-823e15b85880 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:36:59.611988 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-a96d558f-5ad7-463d-bb02-823e15b85880 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Getting quotas for project 78a593e163e74a7b9db61133e5c22035. Resources: {'instances', 'ram', 'cores'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 20:36:59.624885 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-a96d558f-5ad7-463d-bb02-823e15b85880 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Getting quotas for user c0b5962b37b2470099436609425f7423 and project 78a593e163e74a7b9db61133e5c22035. Resources: {'instances', 'ram', 'cores'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 20:36:59.634341 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-3460e396-3ed0-4201-84ef-11bab2a29699 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f231f706d2f4d3e9070105bb5981cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f12afd420d4f6bad8e80207ea64d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:36:59.643206 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-a96d558f-5ad7-463d-bb02-823e15b85880 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Going to run 1 instances... {{(pid=124432) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 20:36:59.646743 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-a96d558f-5ad7-463d-bb02-823e15b85880 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: f45998cc-d9ed-4dd5-acf0-caba5d56696d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a759604a-67e3-4c79-b848-5d03d936d7a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 20:36:59.674988 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-3460e396-3ed0-4201-84ef-11bab2a29699 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] 10.222.0.66 "GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188" status: 200 len: 1219 microversion: 2.1 time: 0.613670 Jul 15 20:36:59.683913 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 6/11] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:36:59 2022] GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188 => generated 1219 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:36:59.715184 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-2f97f9ad-36d4-4472-9e3f-bc0cc2dd4d8a tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:36:59.717831 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-2f97f9ad-36d4-4472-9e3f-bc0cc2dd4d8a tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 48c34b54-0234-4763-a6c1-f73c3c075277] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:36:59.801670 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-a96d558f-5ad7-463d-bb02-823e15b85880 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.166121 Jul 15 20:36:59.802342 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 6/12] 10.222.0.66 () {60 vars in 1146 bytes} [Fri Jul 15 20:36:57 2022] POST /compute/v2.1/servers => generated 401 bytes in 2168 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 20:36:59.851353 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-aff990dc-b4c6-4300-8eb5-d66a2319d5e1 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:36:59.856279 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-aff990dc-b4c6-4300-8eb5-d66a2319d5e1 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: f45998cc-d9ed-4dd5-acf0-caba5d56696d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:00.003867 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-2f97f9ad-36d4-4472-9e3f-bc0cc2dd4d8a tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:00.059806 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-2f97f9ad-36d4-4472-9e3f-bc0cc2dd4d8a tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277" status: 200 len: 1222 microversion: 2.1 time: 0.374676 Jul 15 20:37:00.081877 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 7/13] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:36:59 2022] GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277 => generated 1222 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:00.208360 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-aff990dc-b4c6-4300-8eb5-d66a2319d5e1 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:00.263962 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-aff990dc-b4c6-4300-8eb5-d66a2319d5e1 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d" status: 200 len: 1241 microversion: 2.1 time: 0.454942 Jul 15 20:37:00.273368 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 7/14] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:36:59 2022] GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d => generated 1241 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:00.354732 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-5db61f91-89eb-45af-a434-6ba931fe5d36 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1589904743", "imageRef": "a759604a-67e3-4c79-b848-5d03d936d7a0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:37:00.495982 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.network.neutron [None req-5db61f91-89eb-45af-a434-6ba931fe5d36 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] validate_networks() for [('dadb3a1f-a806-41dc-8315-352bd978366a', None, None, None, None, None)] {{(pid=124430) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 20:37:00.718495 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-563fe38d-3ce7-4fbe-9f3c-959694327640 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:00.723798 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-563fe38d-3ce7-4fbe-9f3c-959694327640 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] [instance: 31e74255-0b4d-4c43-91ce-ffccffdc2188] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:00.766735 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-563fe38d-3ce7-4fbe-9f3c-959694327640 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:00.769595 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-563fe38d-3ce7-4fbe-9f3c-959694327640 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:00.774505 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-563fe38d-3ce7-4fbe-9f3c-959694327640 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:00.777493 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-563fe38d-3ce7-4fbe-9f3c-959694327640 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:01.420043 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-563fe38d-3ce7-4fbe-9f3c-959694327640 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f231f706d2f4d3e9070105bb5981cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f12afd420d4f6bad8e80207ea64d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:01.451880 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-563fe38d-3ce7-4fbe-9f3c-959694327640 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] 10.222.0.66 "GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188" status: 200 len: 1275 microversion: 2.1 time: 0.756592 Jul 15 20:37:01.460471 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 8/15] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:00 2022] GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188 => generated 1275 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:01.492164 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-03a43dac-7d58-40c1-8075-7673ffcfe195 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:01.494742 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-03a43dac-7d58-40c1-8075-7673ffcfe195 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: f45998cc-d9ed-4dd5-acf0-caba5d56696d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:01.511381 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-03a43dac-7d58-40c1-8075-7673ffcfe195 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:01.512797 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-03a43dac-7d58-40c1-8075-7673ffcfe195 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:01.513588 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-03a43dac-7d58-40c1-8075-7673ffcfe195 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:01.515197 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-03a43dac-7d58-40c1-8075-7673ffcfe195 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:01.778637 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-03a43dac-7d58-40c1-8075-7673ffcfe195 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:01.793033 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-03a43dac-7d58-40c1-8075-7673ffcfe195 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d" status: 200 len: 1237 microversion: 2.1 time: 0.319704 Jul 15 20:37:01.793994 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 9/16] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:01 2022] GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d => generated 1237 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:01.880173 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.virt.hardware [None req-5db61f91-89eb-45af-a434-6ba931fe5d36 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Flavor limits 0:0:0 {{(pid=124430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 20:37:01.880911 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.virt.hardware [None req-5db61f91-89eb-45af-a434-6ba931fe5d36 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Image limits 0:0:0 {{(pid=124430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 20:37:01.881867 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.virt.hardware [None req-5db61f91-89eb-45af-a434-6ba931fe5d36 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Flavor pref 0:0:0 {{(pid=124430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 20:37:01.882514 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.virt.hardware [None req-5db61f91-89eb-45af-a434-6ba931fe5d36 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Image pref 0:0:0 {{(pid=124430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 20:37:01.883360 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.virt.hardware [None req-5db61f91-89eb-45af-a434-6ba931fe5d36 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 20:37:01.906186 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-5db61f91-89eb-45af-a434-6ba931fe5d36 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:01.907673 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-5db61f91-89eb-45af-a434-6ba931fe5d36 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:01.909251 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-5db61f91-89eb-45af-a434-6ba931fe5d36 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:01.910205 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-5db61f91-89eb-45af-a434-6ba931fe5d36 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:01.953537 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.quota [None req-5db61f91-89eb-45af-a434-6ba931fe5d36 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Getting quotas for project 0395d91380b34e968d7e39be3bc88b0f. Resources: {'instances', 'ram', 'cores'} {{(pid=124430) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 20:37:01.962651 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.quota [None req-5db61f91-89eb-45af-a434-6ba931fe5d36 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Getting quotas for user e13d5d7068e348248387b512c55dec5e and project 0395d91380b34e968d7e39be3bc88b0f. Resources: {'instances', 'ram', 'cores'} {{(pid=124430) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 20:37:01.986036 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-5db61f91-89eb-45af-a434-6ba931fe5d36 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Going to run 1 instances... {{(pid=124430) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 20:37:01.989754 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-5db61f91-89eb-45af-a434-6ba931fe5d36 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a759604a-67e3-4c79-b848-5d03d936d7a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124430) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 20:37:02.118350 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-5db61f91-89eb-45af-a434-6ba931fe5d36 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.767382 Jul 15 20:37:02.128493 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 8/17] 10.222.0.66 () {60 vars in 1146 bytes} [Fri Jul 15 20:37:00 2022] POST /compute/v2.1/servers => generated 383 bytes in 1778 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 20:37:02.131892 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-8c6a8129-3ea3-4179-9e52-4dde29747388 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:02.133079 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-8c6a8129-3ea3-4179-9e52-4dde29747388 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:02.281923 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-8c6a8129-3ea3-4179-9e52-4dde29747388 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:02.294338 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-8c6a8129-3ea3-4179-9e52-4dde29747388 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc" status: 200 len: 1222 microversion: 2.1 time: 0.165986 Jul 15 20:37:02.297973 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 10/18] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:02 2022] GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc => generated 1222 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:37:02.479452 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-42032819-2d82-4e59-8a2e-87ca0a94a8c1 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:02.480460 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-42032819-2d82-4e59-8a2e-87ca0a94a8c1 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] [instance: 31e74255-0b4d-4c43-91ce-ffccffdc2188] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:02.499151 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-42032819-2d82-4e59-8a2e-87ca0a94a8c1 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:02.500893 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-42032819-2d82-4e59-8a2e-87ca0a94a8c1 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:02.513345 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-42032819-2d82-4e59-8a2e-87ca0a94a8c1 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:02.514367 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-42032819-2d82-4e59-8a2e-87ca0a94a8c1 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:02.686194 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-42032819-2d82-4e59-8a2e-87ca0a94a8c1 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f231f706d2f4d3e9070105bb5981cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f12afd420d4f6bad8e80207ea64d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:02.698316 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-42032819-2d82-4e59-8a2e-87ca0a94a8c1 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] 10.222.0.66 "GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188" status: 200 len: 1273 microversion: 2.1 time: 0.223641 Jul 15 20:37:02.711787 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 9/19] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:02 2022] GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188 => generated 1273 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:37:02.816662 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-926652f9-04d2-4003-8b49-4ab5ce668ed9 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:02.818433 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-926652f9-04d2-4003-8b49-4ab5ce668ed9 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: f45998cc-d9ed-4dd5-acf0-caba5d56696d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:02.832876 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-926652f9-04d2-4003-8b49-4ab5ce668ed9 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:02.837827 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-926652f9-04d2-4003-8b49-4ab5ce668ed9 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:02.842077 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-926652f9-04d2-4003-8b49-4ab5ce668ed9 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:02.842812 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-926652f9-04d2-4003-8b49-4ab5ce668ed9 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:03.212265 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-926652f9-04d2-4003-8b49-4ab5ce668ed9 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:03.222470 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-926652f9-04d2-4003-8b49-4ab5ce668ed9 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d" status: 200 len: 1311 microversion: 2.1 time: 0.409733 Jul 15 20:37:03.225126 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 11/20] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:02 2022] GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d => generated 1311 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:03.314872 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-f5d443b6-f9c4-49c3-b4c4-fac121ffcdd9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:03.316766 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-f5d443b6-f9c4-49c3-b4c4-fac121ffcdd9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:03.727411 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-14ae74be-3669-477a-a29a-7a10e2c7cb82 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:03.727820 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-14ae74be-3669-477a-a29a-7a10e2c7cb82 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] [instance: 31e74255-0b4d-4c43-91ce-ffccffdc2188] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:03.746979 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-14ae74be-3669-477a-a29a-7a10e2c7cb82 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:03.750921 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-14ae74be-3669-477a-a29a-7a10e2c7cb82 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:03.755857 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-14ae74be-3669-477a-a29a-7a10e2c7cb82 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:03.769777 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-14ae74be-3669-477a-a29a-7a10e2c7cb82 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:04.124708 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-f5d443b6-f9c4-49c3-b4c4-fac121ffcdd9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:04.164288 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-f5d443b6-f9c4-49c3-b4c4-fac121ffcdd9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc" status: 200 len: 1222 microversion: 2.1 time: 0.853117 Jul 15 20:37:04.177409 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 10/21] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:03 2022] GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc => generated 1222 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:04.246907 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-6ff15034-d89d-46cf-828d-bfe68604a188 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:04.248177 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-6ff15034-d89d-46cf-828d-bfe68604a188 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: f45998cc-d9ed-4dd5-acf0-caba5d56696d] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:04.276335 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-6ff15034-d89d-46cf-828d-bfe68604a188 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:04.297428 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-6ff15034-d89d-46cf-828d-bfe68604a188 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:04.298565 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-6ff15034-d89d-46cf-828d-bfe68604a188 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:04.301152 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-6ff15034-d89d-46cf-828d-bfe68604a188 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:04.997584 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-6ff15034-d89d-46cf-828d-bfe68604a188 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:05.007405 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-6ff15034-d89d-46cf-828d-bfe68604a188 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d" status: 200 len: 1299 microversion: 2.1 time: 0.766334 Jul 15 20:37:05.020567 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 11/22] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:04 2022] GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d => generated 1299 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:05.198175 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-80c9fa19-fe5a-42c5-94c4-03dbf52be3d8 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:05.199276 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-80c9fa19-fe5a-42c5-94c4-03dbf52be3d8 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:05.217125 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-80c9fa19-fe5a-42c5-94c4-03dbf52be3d8 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:05.218150 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-80c9fa19-fe5a-42c5-94c4-03dbf52be3d8 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:05.220381 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-80c9fa19-fe5a-42c5-94c4-03dbf52be3d8 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:05.225416 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-80c9fa19-fe5a-42c5-94c4-03dbf52be3d8 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:05.807402 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-14ae74be-3669-477a-a29a-7a10e2c7cb82 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f231f706d2f4d3e9070105bb5981cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f12afd420d4f6bad8e80207ea64d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:05.818595 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-14ae74be-3669-477a-a29a-7a10e2c7cb82 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] 10.222.0.66 "GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188" status: 200 len: 1315 microversion: 2.1 time: 2.095640 Jul 15 20:37:05.823889 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 12/23] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:03 2022] GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188 => generated 1315 bytes in 2102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:05.947740 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-80c9fa19-fe5a-42c5-94c4-03dbf52be3d8 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:05.963214 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-80c9fa19-fe5a-42c5-94c4-03dbf52be3d8 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc" status: 200 len: 1274 microversion: 2.1 time: 0.769880 Jul 15 20:37:05.964609 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 12/24] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:05 2022] GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc => generated 1274 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:06.027103 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-7efa5d67-4c0e-43b7-a09e-29e002c7087f tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:06.027933 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-7efa5d67-4c0e-43b7-a09e-29e002c7087f tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: f45998cc-d9ed-4dd5-acf0-caba5d56696d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:06.038588 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7efa5d67-4c0e-43b7-a09e-29e002c7087f tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:06.042635 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7efa5d67-4c0e-43b7-a09e-29e002c7087f tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:06.043927 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7efa5d67-4c0e-43b7-a09e-29e002c7087f tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:06.044539 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7efa5d67-4c0e-43b7-a09e-29e002c7087f tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:06.204069 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-7efa5d67-4c0e-43b7-a09e-29e002c7087f tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:06.212566 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-7efa5d67-4c0e-43b7-a09e-29e002c7087f tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d" status: 200 len: 1299 microversion: 2.1 time: 0.190441 Jul 15 20:37:06.218738 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 13/25] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:06 2022] GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d => generated 1299 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:06.841215 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-08b3f86d-f3a1-410b-bc1e-5491fc40d461 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:06.842513 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-08b3f86d-f3a1-410b-bc1e-5491fc40d461 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] [instance: 31e74255-0b4d-4c43-91ce-ffccffdc2188] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:06.861044 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-08b3f86d-f3a1-410b-bc1e-5491fc40d461 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:06.861696 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-08b3f86d-f3a1-410b-bc1e-5491fc40d461 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:06.863055 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-08b3f86d-f3a1-410b-bc1e-5491fc40d461 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:06.865283 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-08b3f86d-f3a1-410b-bc1e-5491fc40d461 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:06.986213 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-cbf0ae2e-8b06-4a65-86ea-34951ec629f9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:06.986829 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-cbf0ae2e-8b06-4a65-86ea-34951ec629f9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:07.005114 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-cbf0ae2e-8b06-4a65-86ea-34951ec629f9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:07.008317 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-cbf0ae2e-8b06-4a65-86ea-34951ec629f9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:07.014184 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-cbf0ae2e-8b06-4a65-86ea-34951ec629f9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:07.015817 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-cbf0ae2e-8b06-4a65-86ea-34951ec629f9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:07.145269 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-cbf0ae2e-8b06-4a65-86ea-34951ec629f9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:07.154838 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-cbf0ae2e-8b06-4a65-86ea-34951ec629f9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc" status: 200 len: 1280 microversion: 2.1 time: 0.172327 Jul 15 20:37:07.157739 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 14/26] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:06 2022] GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc => generated 1280 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:07.221018 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-08b3f86d-f3a1-410b-bc1e-5491fc40d461 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f231f706d2f4d3e9070105bb5981cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f12afd420d4f6bad8e80207ea64d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:07.230986 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-08b3f86d-f3a1-410b-bc1e-5491fc40d461 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] 10.222.0.66 "GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188" status: 200 len: 1315 microversion: 2.1 time: 0.393326 Jul 15 20:37:07.232123 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-fadd5116-9fbc-4a68-a354-efb676ec1802 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:07.232532 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 13/27] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:06 2022] GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188 => generated 1315 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:07.232995 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-fadd5116-9fbc-4a68-a354-efb676ec1802 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: f45998cc-d9ed-4dd5-acf0-caba5d56696d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:07.246549 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fadd5116-9fbc-4a68-a354-efb676ec1802 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:07.247258 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fadd5116-9fbc-4a68-a354-efb676ec1802 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:07.248270 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fadd5116-9fbc-4a68-a354-efb676ec1802 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:07.249038 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fadd5116-9fbc-4a68-a354-efb676ec1802 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:07.525127 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-fadd5116-9fbc-4a68-a354-efb676ec1802 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:07.537624 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-fadd5116-9fbc-4a68-a354-efb676ec1802 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d" status: 200 len: 1366 microversion: 2.1 time: 0.311587 Jul 15 20:37:07.538811 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 15/28] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:07 2022] GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d => generated 1366 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:07.585534 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [req-dbf2a1c2-ce6c-4912-82f8-dc32fcac40fb req-415e984f-8fb6-45f3-8819-ae005a376b02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31e74255-0b4d-4c43-91ce-ffccffdc2188", "tag": "e782e7a7-19dc-48bb-8058-13652a1a4b65"}]} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:37:07.597648 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-dbf2a1c2-ce6c-4912-82f8-dc32fcac40fb req-415e984f-8fb6-45f3-8819-ae005a376b02 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:07.598357 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-dbf2a1c2-ce6c-4912-82f8-dc32fcac40fb req-415e984f-8fb6-45f3-8819-ae005a376b02 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:07.619019 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.compute.server_external_events [req-dbf2a1c2-ce6c-4912-82f8-dc32fcac40fb req-415e984f-8fb6-45f3-8819-ae005a376b02 service nova] Creating event network-changed:e782e7a7-19dc-48bb-8058-13652a1a4b65 for instance 31e74255-0b4d-4c43-91ce-ffccffdc2188 on hv-cinder-79987 Jul 15 20:37:07.619551 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-dbf2a1c2-ce6c-4912-82f8-dc32fcac40fb req-415e984f-8fb6-45f3-8819-ae005a376b02 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124430) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 15 20:37:07.621083 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-46b84ec2-1450-4cd2-b820-8694b880c516 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:07.621772 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-46b84ec2-1450-4cd2-b820-8694b880c516 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:07.622793 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-46b84ec2-1450-4cd2-b820-8694b880c516 None None] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:07.623410 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-46b84ec2-1450-4cd2-b820-8694b880c516 None None] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:07.635278 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.compute.rpcapi [None req-46b84ec2-1450-4cd2-b820-8694b880c516 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 15 20:37:07.636622 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-46b84ec2-1450-4cd2-b820-8694b880c516 None None] Releasing lock "compute-rpcapi-router" {{(pid=124430) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 15 20:37:07.663582 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-46b84ec2-1450-4cd2-b820-8694b880c516 None None] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.256753 Jul 15 20:37:07.664904 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 14/29] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:37:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:37:08.174748 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-0d7c4610-f4f3-41cf-b301-4b0bc921b403 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:08.175497 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-0d7c4610-f4f3-41cf-b301-4b0bc921b403 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:08.186595 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0d7c4610-f4f3-41cf-b301-4b0bc921b403 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:08.187145 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0d7c4610-f4f3-41cf-b301-4b0bc921b403 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:08.187963 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0d7c4610-f4f3-41cf-b301-4b0bc921b403 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:08.191718 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0d7c4610-f4f3-41cf-b301-4b0bc921b403 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:08.254048 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-160226ca-a2df-497f-bcc4-78ace5a06ee4 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:08.255614 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-160226ca-a2df-497f-bcc4-78ace5a06ee4 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] [instance: 31e74255-0b4d-4c43-91ce-ffccffdc2188] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:08.273931 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-160226ca-a2df-497f-bcc4-78ace5a06ee4 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:08.275190 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-160226ca-a2df-497f-bcc4-78ace5a06ee4 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:08.276527 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-160226ca-a2df-497f-bcc4-78ace5a06ee4 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:08.277719 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-160226ca-a2df-497f-bcc4-78ace5a06ee4 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:08.316480 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-0d7c4610-f4f3-41cf-b301-4b0bc921b403 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:08.326460 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-0d7c4610-f4f3-41cf-b301-4b0bc921b403 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc" status: 200 len: 1280 microversion: 2.1 time: 0.155817 Jul 15 20:37:08.327183 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 16/30] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:08 2022] GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc => generated 1280 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:08.557898 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-e466ecba-824f-4da4-ae2c-cb50f983283a tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:08.561511 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-e466ecba-824f-4da4-ae2c-cb50f983283a tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: f45998cc-d9ed-4dd5-acf0-caba5d56696d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:08.575069 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e466ecba-824f-4da4-ae2c-cb50f983283a tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:08.577544 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-160226ca-a2df-497f-bcc4-78ace5a06ee4 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f231f706d2f4d3e9070105bb5981cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f12afd420d4f6bad8e80207ea64d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:08.584657 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e466ecba-824f-4da4-ae2c-cb50f983283a tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:08.584657 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e466ecba-824f-4da4-ae2c-cb50f983283a tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:08.584657 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e466ecba-824f-4da4-ae2c-cb50f983283a tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:08.591228 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-160226ca-a2df-497f-bcc4-78ace5a06ee4 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] 10.222.0.66 "GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188" status: 200 len: 1315 microversion: 2.1 time: 0.344998 Jul 15 20:37:08.593104 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 15/31] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:08 2022] GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188 => generated 1315 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:08.821363 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-e466ecba-824f-4da4-ae2c-cb50f983283a tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:08.831513 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-e466ecba-824f-4da4-ae2c-cb50f983283a tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d" status: 200 len: 1366 microversion: 2.1 time: 0.278287 Jul 15 20:37:08.832404 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 17/32] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:08 2022] GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d => generated 1366 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:37:09.344988 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-a2d77982-a413-4778-80cf-3c487ef249ea tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:09.346931 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-a2d77982-a413-4778-80cf-3c487ef249ea tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:09.355689 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-a2d77982-a413-4778-80cf-3c487ef249ea tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:09.356757 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-a2d77982-a413-4778-80cf-3c487ef249ea tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:09.357765 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-a2d77982-a413-4778-80cf-3c487ef249ea tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:09.358418 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-a2d77982-a413-4778-80cf-3c487ef249ea tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:09.611379 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-1d0c41d5-91da-4182-a9ae-d09f49222d20 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:09.612801 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-1d0c41d5-91da-4182-a9ae-d09f49222d20 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] [instance: 31e74255-0b4d-4c43-91ce-ffccffdc2188] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:09.616993 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell0:SELECT=4 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:09.660304 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1d0c41d5-91da-4182-a9ae-d09f49222d20 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:09.665080 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1d0c41d5-91da-4182-a9ae-d09f49222d20 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:09.666549 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1d0c41d5-91da-4182-a9ae-d09f49222d20 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:09.667452 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1d0c41d5-91da-4182-a9ae-d09f49222d20 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:09.680977 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-a2d77982-a413-4778-80cf-3c487ef249ea tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:09.698282 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-a2d77982-a413-4778-80cf-3c487ef249ea tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc" status: 200 len: 1280 microversion: 2.1 time: 0.358284 Jul 15 20:37:09.704029 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 16/33] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:09 2022] GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc => generated 1280 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:37:09.852848 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-54152624-6a15-4994-b955-9ae13e50a0c1 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:09.853471 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-54152624-6a15-4994-b955-9ae13e50a0c1 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: f45998cc-d9ed-4dd5-acf0-caba5d56696d] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:09.874415 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-54152624-6a15-4994-b955-9ae13e50a0c1 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:09.878119 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-54152624-6a15-4994-b955-9ae13e50a0c1 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:09.886438 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-54152624-6a15-4994-b955-9ae13e50a0c1 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:09.889718 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-54152624-6a15-4994-b955-9ae13e50a0c1 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:10.092060 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-1d0c41d5-91da-4182-a9ae-d09f49222d20 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f231f706d2f4d3e9070105bb5981cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f12afd420d4f6bad8e80207ea64d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:10.104052 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-1d0c41d5-91da-4182-a9ae-d09f49222d20 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] 10.222.0.66 "GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188" status: 200 len: 1315 microversion: 2.1 time: 0.496810 Jul 15 20:37:10.108473 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 18/34] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:09 2022] GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188 => generated 1315 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:10.704611 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-54152624-6a15-4994-b955-9ae13e50a0c1 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:10.718581 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-54152624-6a15-4994-b955-9ae13e50a0c1 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d" status: 200 len: 1366 microversion: 2.1 time: 0.869748 Jul 15 20:37:10.720719 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-aa920e11-31b7-44f9-9514-0eea4645280b tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:10.721728 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-aa920e11-31b7-44f9-9514-0eea4645280b tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:10.723206 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 17/35] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:09 2022] GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d => generated 1366 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:10.732091 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-aa920e11-31b7-44f9-9514-0eea4645280b tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:10.736805 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-aa920e11-31b7-44f9-9514-0eea4645280b tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:10.739254 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-aa920e11-31b7-44f9-9514-0eea4645280b tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:10.739688 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-aa920e11-31b7-44f9-9514-0eea4645280b tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:10.980441 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-aa920e11-31b7-44f9-9514-0eea4645280b tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:10.995748 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-aa920e11-31b7-44f9-9514-0eea4645280b tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc" status: 200 len: 1280 microversion: 2.1 time: 0.278708 Jul 15 20:37:11.008994 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 19/36] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:10 2022] GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc => generated 1280 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:11.122895 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-d13b1ee6-6fec-4b77-b97e-7bdbf5ccd075 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:11.124153 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-d13b1ee6-6fec-4b77-b97e-7bdbf5ccd075 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] [instance: 31e74255-0b4d-4c43-91ce-ffccffdc2188] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:11.136458 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d13b1ee6-6fec-4b77-b97e-7bdbf5ccd075 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:11.138886 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d13b1ee6-6fec-4b77-b97e-7bdbf5ccd075 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:11.145641 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d13b1ee6-6fec-4b77-b97e-7bdbf5ccd075 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:11.148565 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d13b1ee6-6fec-4b77-b97e-7bdbf5ccd075 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:11.740728 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-0449df57-83f4-4b7f-abd2-aeb43edb0a72 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:11.741483 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-0449df57-83f4-4b7f-abd2-aeb43edb0a72 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: f45998cc-d9ed-4dd5-acf0-caba5d56696d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:11.760926 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0449df57-83f4-4b7f-abd2-aeb43edb0a72 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:11.763060 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0449df57-83f4-4b7f-abd2-aeb43edb0a72 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:11.767804 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0449df57-83f4-4b7f-abd2-aeb43edb0a72 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:11.771204 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0449df57-83f4-4b7f-abd2-aeb43edb0a72 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:11.805062 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-d13b1ee6-6fec-4b77-b97e-7bdbf5ccd075 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f231f706d2f4d3e9070105bb5981cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f12afd420d4f6bad8e80207ea64d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:11.824544 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-d13b1ee6-6fec-4b77-b97e-7bdbf5ccd075 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] 10.222.0.66 "GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188" status: 200 len: 1315 microversion: 2.1 time: 0.702707 Jul 15 20:37:11.842576 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 18/37] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:11 2022] GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188 => generated 1315 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:12.014626 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-e4e65f24-4118-4b20-a411-7c1e398d80f7 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:12.015254 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-e4e65f24-4118-4b20-a411-7c1e398d80f7 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:12.035866 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e4e65f24-4118-4b20-a411-7c1e398d80f7 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:12.036327 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e4e65f24-4118-4b20-a411-7c1e398d80f7 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:12.037165 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e4e65f24-4118-4b20-a411-7c1e398d80f7 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:12.037646 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e4e65f24-4118-4b20-a411-7c1e398d80f7 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:12.287353 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell0:SELECT=18 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:12.598251 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-e4e65f24-4118-4b20-a411-7c1e398d80f7 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:12.616965 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-e4e65f24-4118-4b20-a411-7c1e398d80f7 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc" status: 200 len: 1280 microversion: 2.1 time: 0.602187 Jul 15 20:37:12.624199 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 19/38] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:12 2022] GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc => generated 1280 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:37:12.733503 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-0449df57-83f4-4b7f-abd2-aeb43edb0a72 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:12.746539 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-0449df57-83f4-4b7f-abd2-aeb43edb0a72 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d" status: 200 len: 1366 microversion: 2.1 time: 1.009340 Jul 15 20:37:12.759333 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 20/39] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:11 2022] GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d => generated 1366 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:12.845682 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-e5431d1b-bb59-4a1f-ab40-33f647cb0d26 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:12.846596 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-e5431d1b-bb59-4a1f-ab40-33f647cb0d26 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] [instance: 31e74255-0b4d-4c43-91ce-ffccffdc2188] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:12.862748 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e5431d1b-bb59-4a1f-ab40-33f647cb0d26 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:12.866333 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e5431d1b-bb59-4a1f-ab40-33f647cb0d26 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:12.867564 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e5431d1b-bb59-4a1f-ab40-33f647cb0d26 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:12.871644 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e5431d1b-bb59-4a1f-ab40-33f647cb0d26 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:13.640917 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-2ad70635-da59-4a98-8729-cd5fb83e33fd tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:13.641793 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-2ad70635-da59-4a98-8729-cd5fb83e33fd tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:13.664194 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2ad70635-da59-4a98-8729-cd5fb83e33fd tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:13.669638 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2ad70635-da59-4a98-8729-cd5fb83e33fd tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:13.674812 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2ad70635-da59-4a98-8729-cd5fb83e33fd tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:13.675344 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2ad70635-da59-4a98-8729-cd5fb83e33fd tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:13.775428 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-e5431d1b-bb59-4a1f-ab40-33f647cb0d26 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f231f706d2f4d3e9070105bb5981cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f12afd420d4f6bad8e80207ea64d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:13.785633 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-e5431d1b-bb59-4a1f-ab40-33f647cb0d26 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] 10.222.0.66 "GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188" status: 200 len: 1315 microversion: 2.1 time: 0.943091 Jul 15 20:37:13.787533 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 20/40] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:12 2022] GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188 => generated 1315 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:37:13.867401 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-2ad70635-da59-4a98-8729-cd5fb83e33fd tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:13.890638 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-2ad70635-da59-4a98-8729-cd5fb83e33fd tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc" status: 200 len: 1280 microversion: 2.1 time: 0.253408 Jul 15 20:37:13.891233 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 21/41] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:13 2022] GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc => generated 1280 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:13.928154 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-c8684492-46ba-49eb-95d0-5c4da6726182 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:13.930320 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-c8684492-46ba-49eb-95d0-5c4da6726182 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: f45998cc-d9ed-4dd5-acf0-caba5d56696d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:13.980493 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c8684492-46ba-49eb-95d0-5c4da6726182 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:13.982989 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c8684492-46ba-49eb-95d0-5c4da6726182 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:13.991431 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c8684492-46ba-49eb-95d0-5c4da6726182 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:13.994725 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c8684492-46ba-49eb-95d0-5c4da6726182 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:14.005942 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [req-5bc16ede-b247-4298-aa73-5c70ff1f2330 req-7a677f73-c1c3-48bb-a7d0-03f4ec058336 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f45998cc-d9ed-4dd5-acf0-caba5d56696d", "tag": "af14f3e2-18e6-4ff3-b57f-afda50ef445b"}]} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:37:14.028958 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-5bc16ede-b247-4298-aa73-5c70ff1f2330 req-7a677f73-c1c3-48bb-a7d0-03f4ec058336 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:14.035546 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-5bc16ede-b247-4298-aa73-5c70ff1f2330 req-7a677f73-c1c3-48bb-a7d0-03f4ec058336 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:14.101694 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.compute.server_external_events [req-5bc16ede-b247-4298-aa73-5c70ff1f2330 req-7a677f73-c1c3-48bb-a7d0-03f4ec058336 service nova] Creating event network-changed:af14f3e2-18e6-4ff3-b57f-afda50ef445b for instance f45998cc-d9ed-4dd5-acf0-caba5d56696d on hv-cinder-79987 Jul 15 20:37:14.116221 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [req-5bc16ede-b247-4298-aa73-5c70ff1f2330 req-7a677f73-c1c3-48bb-a7d0-03f4ec058336 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.327240 Jul 15 20:37:14.116881 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 21/42] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:37:14.698848 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [req-f1ddd0d9-3518-437c-98db-13ae669bdfbc req-c9ac218e-df63-4f32-bd4d-51b4aea796dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48c34b54-0234-4763-a6c1-f73c3c075277", "tag": "f430e1bb-7731-410f-ac4d-4f4b0b340704"}]} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:37:14.724343 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-c8684492-46ba-49eb-95d0-5c4da6726182 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:14.731095 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_cell0:SELECT=20 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:14.740370 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-f1ddd0d9-3518-437c-98db-13ae669bdfbc req-c9ac218e-df63-4f32-bd4d-51b4aea796dc service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:14.741821 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-f1ddd0d9-3518-437c-98db-13ae669bdfbc req-c9ac218e-df63-4f32-bd4d-51b4aea796dc service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:14.742528 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-c8684492-46ba-49eb-95d0-5c4da6726182 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d" status: 200 len: 1366 microversion: 2.1 time: 0.830008 Jul 15 20:37:14.743366 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 22/43] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:13 2022] GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d => generated 1366 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:14.790108 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.compute.server_external_events [req-f1ddd0d9-3518-437c-98db-13ae669bdfbc req-c9ac218e-df63-4f32-bd4d-51b4aea796dc service nova] Creating event network-changed:f430e1bb-7731-410f-ac4d-4f4b0b340704 for instance 48c34b54-0234-4763-a6c1-f73c3c075277 on hv-cinder-79987 Jul 15 20:37:14.808124 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-c4dcdd96-fae0-480e-a170-a16f177ec2cc tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:14.809059 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-c4dcdd96-fae0-480e-a170-a16f177ec2cc tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] [instance: 31e74255-0b4d-4c43-91ce-ffccffdc2188] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:14.809556 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [req-f1ddd0d9-3518-437c-98db-13ae669bdfbc req-c9ac218e-df63-4f32-bd4d-51b4aea796dc service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110425 Jul 15 20:37:14.818836 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 22/44] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:37:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:37:14.823897 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c4dcdd96-fae0-480e-a170-a16f177ec2cc tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:14.825072 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c4dcdd96-fae0-480e-a170-a16f177ec2cc tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:14.825836 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c4dcdd96-fae0-480e-a170-a16f177ec2cc tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:14.826284 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c4dcdd96-fae0-480e-a170-a16f177ec2cc tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:14.907989 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-80c097b8-6b8b-4731-8793-a006e8f2dc7f tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:14.908883 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-80c097b8-6b8b-4731-8793-a006e8f2dc7f tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:14.929701 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-80c097b8-6b8b-4731-8793-a006e8f2dc7f tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:14.931494 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-80c097b8-6b8b-4731-8793-a006e8f2dc7f tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:14.937942 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-80c097b8-6b8b-4731-8793-a006e8f2dc7f tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:14.938865 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-80c097b8-6b8b-4731-8793-a006e8f2dc7f tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:15.190902 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-80c097b8-6b8b-4731-8793-a006e8f2dc7f tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:15.200504 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-80c097b8-6b8b-4731-8793-a006e8f2dc7f tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc" status: 200 len: 1280 microversion: 2.1 time: 0.296760 Jul 15 20:37:15.210876 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 23/45] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:14 2022] GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc => generated 1280 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:37:15.282115 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-c4dcdd96-fae0-480e-a170-a16f177ec2cc tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f231f706d2f4d3e9070105bb5981cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f12afd420d4f6bad8e80207ea64d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:15.293874 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-c4dcdd96-fae0-480e-a170-a16f177ec2cc tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] 10.222.0.66 "GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188" status: 200 len: 1315 microversion: 2.1 time: 0.494699 Jul 15 20:37:15.295767 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 23/46] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:14 2022] GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188 => generated 1315 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:37:15.761652 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-183e5976-150b-47d8-ba6a-6ce9fbe9f638 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:15.762396 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-183e5976-150b-47d8-ba6a-6ce9fbe9f638 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: f45998cc-d9ed-4dd5-acf0-caba5d56696d] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:15.770988 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-183e5976-150b-47d8-ba6a-6ce9fbe9f638 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:15.771718 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-183e5976-150b-47d8-ba6a-6ce9fbe9f638 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:15.773979 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-183e5976-150b-47d8-ba6a-6ce9fbe9f638 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:15.775094 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-183e5976-150b-47d8-ba6a-6ce9fbe9f638 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:15.962113 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-183e5976-150b-47d8-ba6a-6ce9fbe9f638 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:15.971880 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-183e5976-150b-47d8-ba6a-6ce9fbe9f638 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d" status: 200 len: 1366 microversion: 2.1 time: 0.213310 Jul 15 20:37:15.973661 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 24/47] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:15 2022] GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d => generated 1366 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:16.228741 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-be8c95ec-1a5d-4431-ba81-eaab0009bed5 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:16.229363 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-be8c95ec-1a5d-4431-ba81-eaab0009bed5 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:16.236002 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-be8c95ec-1a5d-4431-ba81-eaab0009bed5 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:16.236476 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-be8c95ec-1a5d-4431-ba81-eaab0009bed5 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:16.238320 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-be8c95ec-1a5d-4431-ba81-eaab0009bed5 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:16.239047 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-be8c95ec-1a5d-4431-ba81-eaab0009bed5 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:16.312672 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-bed55c62-f95a-4711-8660-6d73b71b76fe tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:16.313922 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-bed55c62-f95a-4711-8660-6d73b71b76fe tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] [instance: 31e74255-0b4d-4c43-91ce-ffccffdc2188] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:16.321845 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-bed55c62-f95a-4711-8660-6d73b71b76fe tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:16.322366 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-bed55c62-f95a-4711-8660-6d73b71b76fe tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:16.323602 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-bed55c62-f95a-4711-8660-6d73b71b76fe tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:16.324131 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-bed55c62-f95a-4711-8660-6d73b71b76fe tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:16.461294 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-be8c95ec-1a5d-4431-ba81-eaab0009bed5 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:16.467473 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell1:SELECT=100 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:16.475463 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-be8c95ec-1a5d-4431-ba81-eaab0009bed5 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc" status: 200 len: 1322 microversion: 2.1 time: 0.251556 Jul 15 20:37:16.480737 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 24/48] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:16 2022] GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc => generated 1322 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:16.534088 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-bed55c62-f95a-4711-8660-6d73b71b76fe tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f231f706d2f4d3e9070105bb5981cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f12afd420d4f6bad8e80207ea64d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:16.541589 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-bed55c62-f95a-4711-8660-6d73b71b76fe tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] 10.222.0.66 "GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188" status: 200 len: 1315 microversion: 2.1 time: 0.233416 Jul 15 20:37:16.542471 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 25/49] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:16 2022] GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188 => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:16.990791 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-cc6be0e3-8201-4d5c-9fc8-7db93189e330 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:16.991397 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-cc6be0e3-8201-4d5c-9fc8-7db93189e330 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: f45998cc-d9ed-4dd5-acf0-caba5d56696d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:16.998481 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-cc6be0e3-8201-4d5c-9fc8-7db93189e330 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:16.999005 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-cc6be0e3-8201-4d5c-9fc8-7db93189e330 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:16.999776 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-cc6be0e3-8201-4d5c-9fc8-7db93189e330 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:17.000207 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-cc6be0e3-8201-4d5c-9fc8-7db93189e330 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:17.150348 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-cc6be0e3-8201-4d5c-9fc8-7db93189e330 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:17.159991 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-cc6be0e3-8201-4d5c-9fc8-7db93189e330 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d" status: 200 len: 1366 microversion: 2.1 time: 0.173886 Jul 15 20:37:17.161115 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 25/50] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:16 2022] GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:17.495299 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-0a91878c-be7d-4ac4-a0b1-964562fb5d2e tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:17.495911 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-0a91878c-be7d-4ac4-a0b1-964562fb5d2e tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:17.503756 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-0a91878c-be7d-4ac4-a0b1-964562fb5d2e tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:17.504316 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-0a91878c-be7d-4ac4-a0b1-964562fb5d2e tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:17.505100 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-0a91878c-be7d-4ac4-a0b1-964562fb5d2e tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:17.505535 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-0a91878c-be7d-4ac4-a0b1-964562fb5d2e tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:17.540215 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_cell1:SELECT=100 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:17.566361 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-bd57b5b8-a278-41e2-9d33-9a704c42a622 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:17.567912 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-bd57b5b8-a278-41e2-9d33-9a704c42a622 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] [instance: 31e74255-0b4d-4c43-91ce-ffccffdc2188] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:17.589239 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-bd57b5b8-a278-41e2-9d33-9a704c42a622 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:17.591373 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-bd57b5b8-a278-41e2-9d33-9a704c42a622 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:17.608869 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-bd57b5b8-a278-41e2-9d33-9a704c42a622 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:17.610444 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-bd57b5b8-a278-41e2-9d33-9a704c42a622 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:17.633006 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_cell0:SELECT=6 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:17.815763 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-0a91878c-be7d-4ac4-a0b1-964562fb5d2e tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:17.855832 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-0a91878c-be7d-4ac4-a0b1-964562fb5d2e tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc" status: 200 len: 1322 microversion: 2.1 time: 0.366942 Jul 15 20:37:17.864742 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 26/51] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:17 2022] GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc => generated 1322 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:17.872489 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-bd57b5b8-a278-41e2-9d33-9a704c42a622 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f231f706d2f4d3e9070105bb5981cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f12afd420d4f6bad8e80207ea64d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:17.883497 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-bd57b5b8-a278-41e2-9d33-9a704c42a622 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] 10.222.0.66 "GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188" status: 200 len: 1315 microversion: 2.1 time: 0.327947 Jul 15 20:37:17.884504 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 26/52] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:17 2022] GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188 => generated 1315 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:37:18.177965 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-70049b97-fe33-40ef-bea4-6f0dc959f032 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:18.178913 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-70049b97-fe33-40ef-bea4-6f0dc959f032 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: f45998cc-d9ed-4dd5-acf0-caba5d56696d] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:18.187606 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-70049b97-fe33-40ef-bea4-6f0dc959f032 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:18.188769 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-70049b97-fe33-40ef-bea4-6f0dc959f032 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:18.196033 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-70049b97-fe33-40ef-bea4-6f0dc959f032 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:18.196527 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-70049b97-fe33-40ef-bea4-6f0dc959f032 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:18.373736 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-70049b97-fe33-40ef-bea4-6f0dc959f032 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:18.384046 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-70049b97-fe33-40ef-bea4-6f0dc959f032 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d" status: 200 len: 1366 microversion: 2.1 time: 0.210137 Jul 15 20:37:18.392434 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 27/53] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:18 2022] GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d => generated 1366 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:18.875148 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-2e4d6850-7add-4426-9bf8-e2c2c2ae92d7 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:18.875827 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-2e4d6850-7add-4426-9bf8-e2c2c2ae92d7 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:18.886292 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2e4d6850-7add-4426-9bf8-e2c2c2ae92d7 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:18.886667 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2e4d6850-7add-4426-9bf8-e2c2c2ae92d7 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:18.887460 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2e4d6850-7add-4426-9bf8-e2c2c2ae92d7 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:18.887892 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2e4d6850-7add-4426-9bf8-e2c2c2ae92d7 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:18.900778 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-09608373-74d0-42fc-b1c6-51b708a90ad6 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:18.901986 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-09608373-74d0-42fc-b1c6-51b708a90ad6 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] [instance: 31e74255-0b4d-4c43-91ce-ffccffdc2188] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:18.911410 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-09608373-74d0-42fc-b1c6-51b708a90ad6 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:18.911869 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-09608373-74d0-42fc-b1c6-51b708a90ad6 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:18.912794 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-09608373-74d0-42fc-b1c6-51b708a90ad6 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:18.913465 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-09608373-74d0-42fc-b1c6-51b708a90ad6 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:19.124677 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-2e4d6850-7add-4426-9bf8-e2c2c2ae92d7 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:19.133429 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-2e4d6850-7add-4426-9bf8-e2c2c2ae92d7 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc" status: 200 len: 1322 microversion: 2.1 time: 0.262184 Jul 15 20:37:19.145903 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 27/54] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:18 2022] GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc => generated 1322 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:19.169864 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-09608373-74d0-42fc-b1c6-51b708a90ad6 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f231f706d2f4d3e9070105bb5981cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f12afd420d4f6bad8e80207ea64d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:19.179830 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-09608373-74d0-42fc-b1c6-51b708a90ad6 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] 10.222.0.66 "GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188" status: 200 len: 1315 microversion: 2.1 time: 0.281990 Jul 15 20:37:19.180495 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 28/55] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:18 2022] GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188 => generated 1315 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:37:19.401021 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-50bff729-97de-44cf-9b7e-e6e5e4b03a16 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:19.401621 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-50bff729-97de-44cf-9b7e-e6e5e4b03a16 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: f45998cc-d9ed-4dd5-acf0-caba5d56696d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:19.407556 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-50bff729-97de-44cf-9b7e-e6e5e4b03a16 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:19.407998 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-50bff729-97de-44cf-9b7e-e6e5e4b03a16 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:19.408834 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-50bff729-97de-44cf-9b7e-e6e5e4b03a16 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:19.409258 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-50bff729-97de-44cf-9b7e-e6e5e4b03a16 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:19.550949 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-50bff729-97de-44cf-9b7e-e6e5e4b03a16 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:19.558591 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-50bff729-97de-44cf-9b7e-e6e5e4b03a16 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d" status: 200 len: 1366 microversion: 2.1 time: 0.161233 Jul 15 20:37:19.559170 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 28/56] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:19 2022] GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:20.155036 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-40975878-98bd-4643-a8bc-0607f2532c1d tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:20.155800 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-40975878-98bd-4643-a8bc-0607f2532c1d tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:20.162310 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-40975878-98bd-4643-a8bc-0607f2532c1d tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:20.162757 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-40975878-98bd-4643-a8bc-0607f2532c1d tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:20.163549 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-40975878-98bd-4643-a8bc-0607f2532c1d tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:20.163984 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-40975878-98bd-4643-a8bc-0607f2532c1d tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:20.202981 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-182b3a20-564c-4666-9a0c-b36839d30a2d tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:20.203603 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-182b3a20-564c-4666-9a0c-b36839d30a2d tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] [instance: 31e74255-0b4d-4c43-91ce-ffccffdc2188] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:20.211120 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-182b3a20-564c-4666-9a0c-b36839d30a2d tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:20.211879 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-182b3a20-564c-4666-9a0c-b36839d30a2d tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:20.213064 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-182b3a20-564c-4666-9a0c-b36839d30a2d tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:20.213932 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-182b3a20-564c-4666-9a0c-b36839d30a2d tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:20.361612 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-40975878-98bd-4643-a8bc-0607f2532c1d tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:20.372578 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-40975878-98bd-4643-a8bc-0607f2532c1d tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc" status: 200 len: 1322 microversion: 2.1 time: 0.221063 Jul 15 20:37:20.374169 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 29/57] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:20 2022] GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:20.402008 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-182b3a20-564c-4666-9a0c-b36839d30a2d tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f231f706d2f4d3e9070105bb5981cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f12afd420d4f6bad8e80207ea64d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:20.411068 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-182b3a20-564c-4666-9a0c-b36839d30a2d tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] 10.222.0.66 "GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188" status: 200 len: 1315 microversion: 2.1 time: 0.211948 Jul 15 20:37:20.411590 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 29/58] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:20 2022] GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188 => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:20.575882 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-cb1809f0-1e7b-4d6e-8ae9-2dd7d195b892 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:20.576946 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-cb1809f0-1e7b-4d6e-8ae9-2dd7d195b892 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: f45998cc-d9ed-4dd5-acf0-caba5d56696d] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:20.583032 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-cb1809f0-1e7b-4d6e-8ae9-2dd7d195b892 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:20.583715 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-cb1809f0-1e7b-4d6e-8ae9-2dd7d195b892 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:20.584493 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-cb1809f0-1e7b-4d6e-8ae9-2dd7d195b892 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:20.584918 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-cb1809f0-1e7b-4d6e-8ae9-2dd7d195b892 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:20.807417 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-cb1809f0-1e7b-4d6e-8ae9-2dd7d195b892 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:20.816009 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-cb1809f0-1e7b-4d6e-8ae9-2dd7d195b892 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d" status: 200 len: 1366 microversion: 2.1 time: 0.243643 Jul 15 20:37:20.816721 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 30/59] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:20 2022] GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d => generated 1366 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:21.395376 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-875e46f0-33e6-4845-8d07-a1b43e538ed2 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:21.398003 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-875e46f0-33e6-4845-8d07-a1b43e538ed2 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:21.430266 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-e7b737e2-73ec-4b47-a98f-fb9b2d73070d tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:21.430908 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-e7b737e2-73ec-4b47-a98f-fb9b2d73070d tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] [instance: 31e74255-0b4d-4c43-91ce-ffccffdc2188] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:21.435480 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-875e46f0-33e6-4845-8d07-a1b43e538ed2 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:21.435943 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-875e46f0-33e6-4845-8d07-a1b43e538ed2 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:21.436755 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-875e46f0-33e6-4845-8d07-a1b43e538ed2 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:21.437187 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-875e46f0-33e6-4845-8d07-a1b43e538ed2 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:21.448967 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e7b737e2-73ec-4b47-a98f-fb9b2d73070d tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:21.449418 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e7b737e2-73ec-4b47-a98f-fb9b2d73070d tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:21.452751 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e7b737e2-73ec-4b47-a98f-fb9b2d73070d tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:21.453388 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e7b737e2-73ec-4b47-a98f-fb9b2d73070d tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:21.733142 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-875e46f0-33e6-4845-8d07-a1b43e538ed2 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:21.747880 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-875e46f0-33e6-4845-8d07-a1b43e538ed2 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc" status: 200 len: 1322 microversion: 2.1 time: 0.357686 Jul 15 20:37:21.759401 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 30/60] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:21 2022] GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc => generated 1322 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:21.772738 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-1e11099e-6d45-4008-8556-26ba8704bb7a req-bf19dc1e-6fc2-4f5d-8ba2-534e66a76841 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef881276-4314-4f71-8f0e-195af41473bc", "tag": "d7772a75-e1a3-43d1-9412-92dff1189079"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:37:21.791849 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=6 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:21.807143 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-1e11099e-6d45-4008-8556-26ba8704bb7a req-bf19dc1e-6fc2-4f5d-8ba2-534e66a76841 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:21.807617 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-1e11099e-6d45-4008-8556-26ba8704bb7a req-bf19dc1e-6fc2-4f5d-8ba2-534e66a76841 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:21.819440 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-e7b737e2-73ec-4b47-a98f-fb9b2d73070d tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f231f706d2f4d3e9070105bb5981cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f12afd420d4f6bad8e80207ea64d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:21.830695 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-e7b737e2-73ec-4b47-a98f-fb9b2d73070d tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] 10.222.0.66 "GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188" status: 200 len: 1315 microversion: 2.1 time: 0.405525 Jul 15 20:37:21.833120 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 31/61] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:21 2022] GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188 => generated 1315 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:37:21.856849 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-6b6eace6-674a-4bf9-aa87-ebe2282ff6b5 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:21.856849 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-6b6eace6-674a-4bf9-aa87-ebe2282ff6b5 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: f45998cc-d9ed-4dd5-acf0-caba5d56696d] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:21.856849 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:21.859081 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-6b6eace6-674a-4bf9-aa87-ebe2282ff6b5 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:21.860073 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-6b6eace6-674a-4bf9-aa87-ebe2282ff6b5 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:21.882155 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-1e11099e-6d45-4008-8556-26ba8704bb7a req-bf19dc1e-6fc2-4f5d-8ba2-534e66a76841 service nova] Creating event network-changed:d7772a75-e1a3-43d1-9412-92dff1189079 for instance ef881276-4314-4f71-8f0e-195af41473bc on hv-cinder-79987 Jul 15 20:37:21.882595 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-1e11099e-6d45-4008-8556-26ba8704bb7a req-bf19dc1e-6fc2-4f5d-8ba2-534e66a76841 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 15 20:37:21.882891 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-6b6eace6-674a-4bf9-aa87-ebe2282ff6b5 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:21.883623 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-6b6eace6-674a-4bf9-aa87-ebe2282ff6b5 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:21.885936 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-569cd553-44e3-4e76-b539-f734ad759029 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:21.886389 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-569cd553-44e3-4e76-b539-f734ad759029 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:21.887186 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-569cd553-44e3-4e76-b539-f734ad759029 None None] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:21.890340 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-569cd553-44e3-4e76-b539-f734ad759029 None None] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:21.918048 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.compute.rpcapi [None req-569cd553-44e3-4e76-b539-f734ad759029 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 15 20:37:21.921303 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-569cd553-44e3-4e76-b539-f734ad759029 None None] Releasing lock "compute-rpcapi-router" {{(pid=124432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 15 20:37:21.963597 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-569cd553-44e3-4e76-b539-f734ad759029 None None] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.200443 Jul 15 20:37:21.964206 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 31/62] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:37:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:37:22.183028 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-6b6eace6-674a-4bf9-aa87-ebe2282ff6b5 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:22.197761 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-6b6eace6-674a-4bf9-aa87-ebe2282ff6b5 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d" status: 200 len: 1366 microversion: 2.1 time: 0.362986 Jul 15 20:37:22.198342 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 32/63] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:21 2022] GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d => generated 1366 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:22.766150 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-cbdfb31f-52c2-4c85-b625-fde61f9d8a39 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:22.767649 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-cbdfb31f-52c2-4c85-b625-fde61f9d8a39 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:22.779664 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-cbdfb31f-52c2-4c85-b625-fde61f9d8a39 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:22.780791 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-cbdfb31f-52c2-4c85-b625-fde61f9d8a39 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:22.781846 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-cbdfb31f-52c2-4c85-b625-fde61f9d8a39 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:22.782501 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-cbdfb31f-52c2-4c85-b625-fde61f9d8a39 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:22.851179 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-8177ee4d-03e8-4c39-b83b-03a5bc57695c tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:22.852570 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-8177ee4d-03e8-4c39-b83b-03a5bc57695c tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] [instance: 31e74255-0b4d-4c43-91ce-ffccffdc2188] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:22.862511 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8177ee4d-03e8-4c39-b83b-03a5bc57695c tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:22.863285 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8177ee4d-03e8-4c39-b83b-03a5bc57695c tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:22.865072 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8177ee4d-03e8-4c39-b83b-03a5bc57695c tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:22.866011 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8177ee4d-03e8-4c39-b83b-03a5bc57695c tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:23.003818 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-cbdfb31f-52c2-4c85-b625-fde61f9d8a39 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:23.015647 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-cbdfb31f-52c2-4c85-b625-fde61f9d8a39 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc" status: 200 len: 1322 microversion: 2.1 time: 0.253670 Jul 15 20:37:23.021228 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 32/64] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:22 2022] GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc => generated 1322 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:23.093850 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-8177ee4d-03e8-4c39-b83b-03a5bc57695c tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f231f706d2f4d3e9070105bb5981cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f12afd420d4f6bad8e80207ea64d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:23.103846 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-8177ee4d-03e8-4c39-b83b-03a5bc57695c tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] 10.222.0.66 "GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188" status: 200 len: 1315 microversion: 2.1 time: 0.257582 Jul 15 20:37:23.105086 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 33/65] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:22 2022] GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188 => generated 1315 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:37:23.218419 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-95035c9d-27d0-42a9-9409-cbb9af598a86 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:23.219039 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-95035c9d-27d0-42a9-9409-cbb9af598a86 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: f45998cc-d9ed-4dd5-acf0-caba5d56696d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:23.233484 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-95035c9d-27d0-42a9-9409-cbb9af598a86 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:23.234444 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-95035c9d-27d0-42a9-9409-cbb9af598a86 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:23.235256 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-95035c9d-27d0-42a9-9409-cbb9af598a86 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:23.240259 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-95035c9d-27d0-42a9-9409-cbb9af598a86 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:24.008072 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-95035c9d-27d0-42a9-9409-cbb9af598a86 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:24.022619 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-95035c9d-27d0-42a9-9409-cbb9af598a86 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d" status: 200 len: 1366 microversion: 2.1 time: 0.809445 Jul 15 20:37:24.023403 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 33/66] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:23 2022] GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d => generated 1366 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:24.038160 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-97ddc484-761a-4641-a78a-bcbc59bffc38 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:24.039501 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-97ddc484-761a-4641-a78a-bcbc59bffc38 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:24.048058 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-97ddc484-761a-4641-a78a-bcbc59bffc38 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:24.050637 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-97ddc484-761a-4641-a78a-bcbc59bffc38 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:24.051802 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-97ddc484-761a-4641-a78a-bcbc59bffc38 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:24.053378 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-97ddc484-761a-4641-a78a-bcbc59bffc38 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:24.122824 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-61649548-9826-4188-b742-7a03e32bd462 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:24.123669 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-61649548-9826-4188-b742-7a03e32bd462 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] [instance: 31e74255-0b4d-4c43-91ce-ffccffdc2188] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:24.140732 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-61649548-9826-4188-b742-7a03e32bd462 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:24.141659 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-61649548-9826-4188-b742-7a03e32bd462 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:24.143483 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-61649548-9826-4188-b742-7a03e32bd462 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:24.144330 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-61649548-9826-4188-b742-7a03e32bd462 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:24.343562 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-97ddc484-761a-4641-a78a-bcbc59bffc38 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:24.358996 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-97ddc484-761a-4641-a78a-bcbc59bffc38 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc" status: 200 len: 1322 microversion: 2.1 time: 0.324267 Jul 15 20:37:24.360602 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 34/67] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:24 2022] GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc => generated 1322 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:24.440180 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-61649548-9826-4188-b742-7a03e32bd462 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f231f706d2f4d3e9070105bb5981cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f12afd420d4f6bad8e80207ea64d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:24.448060 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-61649548-9826-4188-b742-7a03e32bd462 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] 10.222.0.66 "GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188" status: 200 len: 1315 microversion: 2.1 time: 0.329946 Jul 15 20:37:24.448674 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 34/68] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:24 2022] GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188 => generated 1315 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:25.040094 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-1ce98dd1-5f47-443c-ac9f-7277f556938c tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:25.042839 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-1ce98dd1-5f47-443c-ac9f-7277f556938c tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: f45998cc-d9ed-4dd5-acf0-caba5d56696d] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:25.054287 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-1ce98dd1-5f47-443c-ac9f-7277f556938c tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:25.060495 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-1ce98dd1-5f47-443c-ac9f-7277f556938c tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:25.062245 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-1ce98dd1-5f47-443c-ac9f-7277f556938c tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:25.062913 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-1ce98dd1-5f47-443c-ac9f-7277f556938c tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:25.351811 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-1ce98dd1-5f47-443c-ac9f-7277f556938c tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:25.363061 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-1ce98dd1-5f47-443c-ac9f-7277f556938c tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d" status: 200 len: 1366 microversion: 2.1 time: 0.326660 Jul 15 20:37:25.373661 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 35/69] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:25 2022] GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d => generated 1366 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:25.379437 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-4328fbc7-4002-4495-8681-4ebd89bb2522 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:25.380475 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-4328fbc7-4002-4495-8681-4ebd89bb2522 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:25.392216 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4328fbc7-4002-4495-8681-4ebd89bb2522 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:25.393021 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4328fbc7-4002-4495-8681-4ebd89bb2522 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:25.394063 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4328fbc7-4002-4495-8681-4ebd89bb2522 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:25.394891 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4328fbc7-4002-4495-8681-4ebd89bb2522 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:25.468122 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-c8b3f303-a36e-4c85-9f49-6f658f290716 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:25.468795 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-c8b3f303-a36e-4c85-9f49-6f658f290716 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] [instance: 31e74255-0b4d-4c43-91ce-ffccffdc2188] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:25.489628 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c8b3f303-a36e-4c85-9f49-6f658f290716 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:25.489628 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c8b3f303-a36e-4c85-9f49-6f658f290716 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:25.489628 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c8b3f303-a36e-4c85-9f49-6f658f290716 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:25.489829 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c8b3f303-a36e-4c85-9f49-6f658f290716 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:25.781987 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-c8b3f303-a36e-4c85-9f49-6f658f290716 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f231f706d2f4d3e9070105bb5981cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f12afd420d4f6bad8e80207ea64d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:25.787581 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-4328fbc7-4002-4495-8681-4ebd89bb2522 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:25.798002 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-c8b3f303-a36e-4c85-9f49-6f658f290716 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] 10.222.0.66 "GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188" status: 200 len: 1315 microversion: 2.1 time: 0.333165 Jul 15 20:37:25.798967 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 36/70] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:25 2022] GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188 => generated 1315 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:37:25.803188 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-4328fbc7-4002-4495-8681-4ebd89bb2522 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc" status: 200 len: 1322 microversion: 2.1 time: 0.429237 Jul 15 20:37:25.808892 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 35/71] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:25 2022] GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc => generated 1322 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:26.379846 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-c0192f80-2384-490f-a057-1dfe6d81a80b tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:26.381182 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-c0192f80-2384-490f-a057-1dfe6d81a80b tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: f45998cc-d9ed-4dd5-acf0-caba5d56696d] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:26.387567 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c0192f80-2384-490f-a057-1dfe6d81a80b tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:26.388014 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c0192f80-2384-490f-a057-1dfe6d81a80b tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:26.389061 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c0192f80-2384-490f-a057-1dfe6d81a80b tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:26.389455 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c0192f80-2384-490f-a057-1dfe6d81a80b tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:26.570841 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-c0192f80-2384-490f-a057-1dfe6d81a80b tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:26.586111 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-c0192f80-2384-490f-a057-1dfe6d81a80b tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d" status: 200 len: 1366 microversion: 2.1 time: 0.210163 Jul 15 20:37:26.587452 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 37/72] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:26 2022] GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d => generated 1366 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:26.817550 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-aba4a7ae-58bb-4d47-864f-611a2f6bf4d9 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:26.818522 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-aba4a7ae-58bb-4d47-864f-611a2f6bf4d9 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] [instance: 31e74255-0b4d-4c43-91ce-ffccffdc2188] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:26.822520 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-d186590c-b7c7-4660-898d-3f1ebea5e89c tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:26.822967 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-d186590c-b7c7-4660-898d-3f1ebea5e89c tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:26.831616 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-aba4a7ae-58bb-4d47-864f-611a2f6bf4d9 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:26.832969 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d186590c-b7c7-4660-898d-3f1ebea5e89c tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:26.833506 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-aba4a7ae-58bb-4d47-864f-611a2f6bf4d9 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:26.834081 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d186590c-b7c7-4660-898d-3f1ebea5e89c tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:26.834934 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-aba4a7ae-58bb-4d47-864f-611a2f6bf4d9 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:26.835216 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d186590c-b7c7-4660-898d-3f1ebea5e89c tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:26.835810 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d186590c-b7c7-4660-898d-3f1ebea5e89c tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:26.838151 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-aba4a7ae-58bb-4d47-864f-611a2f6bf4d9 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:27.088372 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-aba4a7ae-58bb-4d47-864f-611a2f6bf4d9 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f231f706d2f4d3e9070105bb5981cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f12afd420d4f6bad8e80207ea64d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:27.099202 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-aba4a7ae-58bb-4d47-864f-611a2f6bf4d9 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] 10.222.0.66 "GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188" status: 200 len: 1315 microversion: 2.1 time: 0.287600 Jul 15 20:37:27.103100 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 36/73] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:26 2022] GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188 => generated 1315 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:37:27.116923 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-d186590c-b7c7-4660-898d-3f1ebea5e89c tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:27.124624 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-d186590c-b7c7-4660-898d-3f1ebea5e89c tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc" status: 200 len: 1322 microversion: 2.1 time: 0.307431 Jul 15 20:37:27.135109 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 38/74] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:26 2022] GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc => generated 1322 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:27.606997 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-1f1ee546-17f3-4f38-828a-f8475960c97f tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:27.607866 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-1f1ee546-17f3-4f38-828a-f8475960c97f tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: f45998cc-d9ed-4dd5-acf0-caba5d56696d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:27.615960 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1f1ee546-17f3-4f38-828a-f8475960c97f tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:27.616533 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1f1ee546-17f3-4f38-828a-f8475960c97f tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:27.617299 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1f1ee546-17f3-4f38-828a-f8475960c97f tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:27.617815 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1f1ee546-17f3-4f38-828a-f8475960c97f tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:27.795030 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-1f1ee546-17f3-4f38-828a-f8475960c97f tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:27.804876 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-1f1ee546-17f3-4f38-828a-f8475960c97f tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d" status: 200 len: 1366 microversion: 2.1 time: 0.202969 Jul 15 20:37:27.805622 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 37/75] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:27 2022] GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d => generated 1366 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:28.118960 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-a704ed79-79d5-43aa-a044-37c22a9e052f tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:28.120103 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-a704ed79-79d5-43aa-a044-37c22a9e052f tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] [instance: 31e74255-0b4d-4c43-91ce-ffccffdc2188] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:28.126710 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-a704ed79-79d5-43aa-a044-37c22a9e052f tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:28.127660 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-a704ed79-79d5-43aa-a044-37c22a9e052f tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:28.128864 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-a704ed79-79d5-43aa-a044-37c22a9e052f tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:28.129448 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-a704ed79-79d5-43aa-a044-37c22a9e052f tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:28.142719 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-3035fb17-7c0c-470c-be0b-3b562cb95bc5 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:28.144019 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-3035fb17-7c0c-470c-be0b-3b562cb95bc5 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:28.150924 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3035fb17-7c0c-470c-be0b-3b562cb95bc5 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:28.151696 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3035fb17-7c0c-470c-be0b-3b562cb95bc5 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:28.152705 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3035fb17-7c0c-470c-be0b-3b562cb95bc5 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:28.153382 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3035fb17-7c0c-470c-be0b-3b562cb95bc5 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:28.356104 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-a704ed79-79d5-43aa-a044-37c22a9e052f tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f231f706d2f4d3e9070105bb5981cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f12afd420d4f6bad8e80207ea64d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:28.367176 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-a704ed79-79d5-43aa-a044-37c22a9e052f tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] 10.222.0.66 "GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188" status: 200 len: 1315 microversion: 2.1 time: 0.251508 Jul 15 20:37:28.367820 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 39/76] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:28 2022] GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188 => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:28.387073 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-3035fb17-7c0c-470c-be0b-3b562cb95bc5 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:28.397769 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-3035fb17-7c0c-470c-be0b-3b562cb95bc5 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc" status: 200 len: 1322 microversion: 2.1 time: 0.258974 Jul 15 20:37:28.399614 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 38/77] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:28 2022] GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc => generated 1322 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:37:28.822745 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-17e9695b-b6ae-45eb-81c3-66449c18d044 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:28.823719 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-17e9695b-b6ae-45eb-81c3-66449c18d044 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: f45998cc-d9ed-4dd5-acf0-caba5d56696d] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:28.836946 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-17e9695b-b6ae-45eb-81c3-66449c18d044 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:28.839395 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-17e9695b-b6ae-45eb-81c3-66449c18d044 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:28.842293 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-17e9695b-b6ae-45eb-81c3-66449c18d044 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:28.842945 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-17e9695b-b6ae-45eb-81c3-66449c18d044 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:29.203271 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-17e9695b-b6ae-45eb-81c3-66449c18d044 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:29.218637 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-17e9695b-b6ae-45eb-81c3-66449c18d044 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d" status: 200 len: 1366 microversion: 2.1 time: 0.400326 Jul 15 20:37:29.221017 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 40/78] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:28 2022] GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d => generated 1366 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:29.385989 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-42878d51-801e-4ac2-bcdd-2ccbe882539a tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:29.387260 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-42878d51-801e-4ac2-bcdd-2ccbe882539a tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] [instance: 31e74255-0b4d-4c43-91ce-ffccffdc2188] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:29.401358 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-42878d51-801e-4ac2-bcdd-2ccbe882539a tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:29.403132 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-42878d51-801e-4ac2-bcdd-2ccbe882539a tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:29.409472 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-42878d51-801e-4ac2-bcdd-2ccbe882539a tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:29.410736 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-42878d51-801e-4ac2-bcdd-2ccbe882539a tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:29.417758 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-b93a6bb7-65c5-489e-95d7-2ac3e93aeb31 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:29.418986 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-b93a6bb7-65c5-489e-95d7-2ac3e93aeb31 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:29.436116 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b93a6bb7-65c5-489e-95d7-2ac3e93aeb31 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:29.438482 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b93a6bb7-65c5-489e-95d7-2ac3e93aeb31 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:29.442815 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b93a6bb7-65c5-489e-95d7-2ac3e93aeb31 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:29.443563 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b93a6bb7-65c5-489e-95d7-2ac3e93aeb31 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:29.706483 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-42878d51-801e-4ac2-bcdd-2ccbe882539a tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f231f706d2f4d3e9070105bb5981cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f12afd420d4f6bad8e80207ea64d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:29.722741 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-42878d51-801e-4ac2-bcdd-2ccbe882539a tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] 10.222.0.66 "GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188" status: 200 len: 1315 microversion: 2.1 time: 0.342666 Jul 15 20:37:29.723719 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 39/79] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:29 2022] GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188 => generated 1315 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:29.747888 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-b93a6bb7-65c5-489e-95d7-2ac3e93aeb31 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:29.758074 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-b93a6bb7-65c5-489e-95d7-2ac3e93aeb31 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc" status: 200 len: 1322 microversion: 2.1 time: 0.345924 Jul 15 20:37:29.758661 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 41/80] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:29 2022] GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc => generated 1322 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:37:30.235784 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-27198cce-0539-4153-bf65-5b185687554b tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:30.237072 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-27198cce-0539-4153-bf65-5b185687554b tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: f45998cc-d9ed-4dd5-acf0-caba5d56696d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:30.243335 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-27198cce-0539-4153-bf65-5b185687554b tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:30.243782 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-27198cce-0539-4153-bf65-5b185687554b tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:30.244689 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-27198cce-0539-4153-bf65-5b185687554b tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:30.245014 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-27198cce-0539-4153-bf65-5b185687554b tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:30.403721 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-27198cce-0539-4153-bf65-5b185687554b tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:30.413644 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-27198cce-0539-4153-bf65-5b185687554b tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d" status: 200 len: 1366 microversion: 2.1 time: 0.181653 Jul 15 20:37:30.414273 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 40/81] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:30 2022] GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:30.740222 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-6728335e-3ab8-4080-98d0-3d84cccee513 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:30.740882 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-6728335e-3ab8-4080-98d0-3d84cccee513 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] [instance: 31e74255-0b4d-4c43-91ce-ffccffdc2188] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:30.747018 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-6728335e-3ab8-4080-98d0-3d84cccee513 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:30.747466 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-6728335e-3ab8-4080-98d0-3d84cccee513 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:30.748227 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-6728335e-3ab8-4080-98d0-3d84cccee513 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:30.748689 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-6728335e-3ab8-4080-98d0-3d84cccee513 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:30.774981 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-fe3d44e9-2e39-4cb2-b46c-719e06ec5d80 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:30.775689 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-fe3d44e9-2e39-4cb2-b46c-719e06ec5d80 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:30.781826 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fe3d44e9-2e39-4cb2-b46c-719e06ec5d80 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:30.782358 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fe3d44e9-2e39-4cb2-b46c-719e06ec5d80 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:30.783254 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fe3d44e9-2e39-4cb2-b46c-719e06ec5d80 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:30.783764 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fe3d44e9-2e39-4cb2-b46c-719e06ec5d80 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:30.939949 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-6728335e-3ab8-4080-98d0-3d84cccee513 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f231f706d2f4d3e9070105bb5981cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f12afd420d4f6bad8e80207ea64d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:30.948204 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-6728335e-3ab8-4080-98d0-3d84cccee513 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] 10.222.0.66 "GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188" status: 200 len: 1315 microversion: 2.1 time: 0.212552 Jul 15 20:37:30.948927 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 42/82] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:30 2022] GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188 => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:30.966145 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-fe3d44e9-2e39-4cb2-b46c-719e06ec5d80 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:30.970084 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell1:SELECT=100 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:30.975666 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-fe3d44e9-2e39-4cb2-b46c-719e06ec5d80 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc" status: 200 len: 1322 microversion: 2.1 time: 0.204674 Jul 15 20:37:30.976315 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 41/83] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:30 2022] GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc => generated 1322 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:31.432115 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-8d2e814e-62a3-48c0-a6ae-d9f05084d06a tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:31.432905 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-8d2e814e-62a3-48c0-a6ae-d9f05084d06a tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: f45998cc-d9ed-4dd5-acf0-caba5d56696d] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:31.440226 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8d2e814e-62a3-48c0-a6ae-d9f05084d06a tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:31.440786 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8d2e814e-62a3-48c0-a6ae-d9f05084d06a tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:31.441650 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8d2e814e-62a3-48c0-a6ae-d9f05084d06a tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:31.442137 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8d2e814e-62a3-48c0-a6ae-d9f05084d06a tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:31.446997 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_cell1:SELECT=100 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:31.593437 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-8d2e814e-62a3-48c0-a6ae-d9f05084d06a tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:31.601738 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-8d2e814e-62a3-48c0-a6ae-d9f05084d06a tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d" status: 200 len: 1366 microversion: 2.1 time: 0.173970 Jul 15 20:37:31.602307 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 43/84] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:31 2022] GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:31.967333 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-39337e13-0b9a-4ece-bab1-370f799fd675 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:31.967869 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-39337e13-0b9a-4ece-bab1-370f799fd675 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] [instance: 31e74255-0b4d-4c43-91ce-ffccffdc2188] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:31.970988 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell0:SELECT=2 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:31.976661 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-39337e13-0b9a-4ece-bab1-370f799fd675 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:31.977110 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-39337e13-0b9a-4ece-bab1-370f799fd675 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:31.977991 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-39337e13-0b9a-4ece-bab1-370f799fd675 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:31.978417 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-39337e13-0b9a-4ece-bab1-370f799fd675 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:31.995326 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-5e7ad667-b7c8-466d-acc6-3fd8045dcf85 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:31.995960 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-5e7ad667-b7c8-466d-acc6-3fd8045dcf85 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:32.002380 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-5e7ad667-b7c8-466d-acc6-3fd8045dcf85 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:32.002991 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-5e7ad667-b7c8-466d-acc6-3fd8045dcf85 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:32.003763 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-5e7ad667-b7c8-466d-acc6-3fd8045dcf85 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:32.004200 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-5e7ad667-b7c8-466d-acc6-3fd8045dcf85 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:32.197785 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-39337e13-0b9a-4ece-bab1-370f799fd675 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f231f706d2f4d3e9070105bb5981cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f12afd420d4f6bad8e80207ea64d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:32.201539 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-5e7ad667-b7c8-466d-acc6-3fd8045dcf85 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:32.207713 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-39337e13-0b9a-4ece-bab1-370f799fd675 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] 10.222.0.66 "GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188" status: 200 len: 1315 microversion: 2.1 time: 0.244905 Jul 15 20:37:32.208496 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 42/85] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:31 2022] GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188 => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:37:32.212239 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-5e7ad667-b7c8-466d-acc6-3fd8045dcf85 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc" status: 200 len: 1322 microversion: 2.1 time: 0.222391 Jul 15 20:37:32.216768 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 44/86] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:31 2022] GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc => generated 1322 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:37:32.618284 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-5a7f90ab-961c-4fa7-bf62-05f28b56cd63 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:32.618915 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-5a7f90ab-961c-4fa7-bf62-05f28b56cd63 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: f45998cc-d9ed-4dd5-acf0-caba5d56696d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:32.624819 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5a7f90ab-961c-4fa7-bf62-05f28b56cd63 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:32.625256 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5a7f90ab-961c-4fa7-bf62-05f28b56cd63 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:32.626010 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5a7f90ab-961c-4fa7-bf62-05f28b56cd63 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:32.626431 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5a7f90ab-961c-4fa7-bf62-05f28b56cd63 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:32.772188 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-5a7f90ab-961c-4fa7-bf62-05f28b56cd63 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:32.780259 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-5a7f90ab-961c-4fa7-bf62-05f28b56cd63 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d" status: 200 len: 1366 microversion: 2.1 time: 0.165645 Jul 15 20:37:32.780887 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 43/87] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:32 2022] GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:33.232846 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-b82dcd90-715c-4510-8bdf-2df8ecd574a1 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:33.233463 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-8ba618ea-eb4a-4746-908e-4b8a0fe52d6c tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:33.233463 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-8ba618ea-eb4a-4746-908e-4b8a0fe52d6c tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:33.233898 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-b82dcd90-715c-4510-8bdf-2df8ecd574a1 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] [instance: 31e74255-0b4d-4c43-91ce-ffccffdc2188] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:33.240694 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8ba618ea-eb4a-4746-908e-4b8a0fe52d6c tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:33.240870 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b82dcd90-715c-4510-8bdf-2df8ecd574a1 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:33.241112 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8ba618ea-eb4a-4746-908e-4b8a0fe52d6c tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:33.241244 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b82dcd90-715c-4510-8bdf-2df8ecd574a1 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:33.241873 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8ba618ea-eb4a-4746-908e-4b8a0fe52d6c tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:33.242005 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b82dcd90-715c-4510-8bdf-2df8ecd574a1 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:33.242425 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b82dcd90-715c-4510-8bdf-2df8ecd574a1 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:33.242665 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8ba618ea-eb4a-4746-908e-4b8a0fe52d6c tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:33.472526 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-b82dcd90-715c-4510-8bdf-2df8ecd574a1 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f231f706d2f4d3e9070105bb5981cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f12afd420d4f6bad8e80207ea64d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:33.481935 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-b82dcd90-715c-4510-8bdf-2df8ecd574a1 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] 10.222.0.66 "GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188" status: 200 len: 1315 microversion: 2.1 time: 0.252774 Jul 15 20:37:33.482517 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 44/88] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:33 2022] GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188 => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:33.487345 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-8ba618ea-eb4a-4746-908e-4b8a0fe52d6c tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:33.499338 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-8ba618ea-eb4a-4746-908e-4b8a0fe52d6c tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc" status: 200 len: 1322 microversion: 2.1 time: 0.269841 Jul 15 20:37:33.499859 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 45/89] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:33 2022] GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc => generated 1322 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:33.802929 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-ac15c399-755b-41dc-8f8a-a0e6ac178c40 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:33.803830 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-ac15c399-755b-41dc-8f8a-a0e6ac178c40 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: f45998cc-d9ed-4dd5-acf0-caba5d56696d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:33.810872 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ac15c399-755b-41dc-8f8a-a0e6ac178c40 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:33.811505 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ac15c399-755b-41dc-8f8a-a0e6ac178c40 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:33.812899 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ac15c399-755b-41dc-8f8a-a0e6ac178c40 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:33.813422 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ac15c399-755b-41dc-8f8a-a0e6ac178c40 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:33.952030 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-ac15c399-755b-41dc-8f8a-a0e6ac178c40 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:33.968382 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-ac15c399-755b-41dc-8f8a-a0e6ac178c40 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d" status: 200 len: 1366 microversion: 2.1 time: 0.171650 Jul 15 20:37:33.969066 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 45/90] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:33 2022] GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:34.498292 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-da450090-1c95-48a6-8c0f-6deee1d03c71 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:34.499108 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-da450090-1c95-48a6-8c0f-6deee1d03c71 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] [instance: 31e74255-0b4d-4c43-91ce-ffccffdc2188] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:34.505115 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-da450090-1c95-48a6-8c0f-6deee1d03c71 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:34.505567 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-da450090-1c95-48a6-8c0f-6deee1d03c71 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:34.506336 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-da450090-1c95-48a6-8c0f-6deee1d03c71 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:34.506771 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-da450090-1c95-48a6-8c0f-6deee1d03c71 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:34.515946 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-3df7feb6-ff20-4f5c-bc7e-b9bf80659463 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:34.516889 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-3df7feb6-ff20-4f5c-bc7e-b9bf80659463 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:34.525713 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3df7feb6-ff20-4f5c-bc7e-b9bf80659463 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:34.526510 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3df7feb6-ff20-4f5c-bc7e-b9bf80659463 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:34.527571 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3df7feb6-ff20-4f5c-bc7e-b9bf80659463 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:34.528007 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3df7feb6-ff20-4f5c-bc7e-b9bf80659463 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:34.905794 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-da450090-1c95-48a6-8c0f-6deee1d03c71 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f231f706d2f4d3e9070105bb5981cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f12afd420d4f6bad8e80207ea64d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:34.910396 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-3df7feb6-ff20-4f5c-bc7e-b9bf80659463 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:34.914198 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-da450090-1c95-48a6-8c0f-6deee1d03c71 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] 10.222.0.66 "GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188" status: 200 len: 1315 microversion: 2.1 time: 0.419833 Jul 15 20:37:34.914771 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 46/91] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:34 2022] GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188 => generated 1315 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:34.919478 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-3df7feb6-ff20-4f5c-bc7e-b9bf80659463 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc" status: 200 len: 1322 microversion: 2.1 time: 0.407357 Jul 15 20:37:34.922308 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 46/92] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:34 2022] GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc => generated 1322 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:34.986833 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-8eb5ae65-b78c-443c-8060-b42969c104e0 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:34.987429 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-8eb5ae65-b78c-443c-8060-b42969c104e0 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: f45998cc-d9ed-4dd5-acf0-caba5d56696d] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:34.993436 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8eb5ae65-b78c-443c-8060-b42969c104e0 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:34.993879 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8eb5ae65-b78c-443c-8060-b42969c104e0 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:34.994627 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8eb5ae65-b78c-443c-8060-b42969c104e0 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:34.995052 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8eb5ae65-b78c-443c-8060-b42969c104e0 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:35.129086 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-8eb5ae65-b78c-443c-8060-b42969c104e0 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:35.137337 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-8eb5ae65-b78c-443c-8060-b42969c104e0 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d" status: 200 len: 1366 microversion: 2.1 time: 0.154300 Jul 15 20:37:35.137903 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 47/93] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:34 2022] GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:35.938937 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-237cf80d-5a6e-464f-a524-0bbb290df0d6 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:35.940465 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-4280ce61-ab75-49c2-af2c-feee710980c5 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:35.941953 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-4280ce61-ab75-49c2-af2c-feee710980c5 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:35.942685 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-237cf80d-5a6e-464f-a524-0bbb290df0d6 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] [instance: 31e74255-0b4d-4c43-91ce-ffccffdc2188] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:35.952058 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-237cf80d-5a6e-464f-a524-0bbb290df0d6 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:35.952605 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-237cf80d-5a6e-464f-a524-0bbb290df0d6 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:35.952718 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-4280ce61-ab75-49c2-af2c-feee710980c5 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:35.953329 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-4280ce61-ab75-49c2-af2c-feee710980c5 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:35.953466 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-237cf80d-5a6e-464f-a524-0bbb290df0d6 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:35.953826 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-237cf80d-5a6e-464f-a524-0bbb290df0d6 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:35.955427 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-4280ce61-ab75-49c2-af2c-feee710980c5 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:35.956113 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-4280ce61-ab75-49c2-af2c-feee710980c5 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:36.229013 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-4280ce61-ab75-49c2-af2c-feee710980c5 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:36.241662 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-4280ce61-ab75-49c2-af2c-feee710980c5 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc" status: 200 len: 1322 microversion: 2.1 time: 0.308134 Jul 15 20:37:36.242516 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 48/94] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:35 2022] GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc => generated 1322 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:37:36.250913 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-237cf80d-5a6e-464f-a524-0bbb290df0d6 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f231f706d2f4d3e9070105bb5981cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f12afd420d4f6bad8e80207ea64d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:36.254748 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-fbd96069-97bc-42ca-a820-e4425cb81271 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:36.255647 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-fbd96069-97bc-42ca-a820-e4425cb81271 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: f45998cc-d9ed-4dd5-acf0-caba5d56696d] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:36.266563 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-237cf80d-5a6e-464f-a524-0bbb290df0d6 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] 10.222.0.66 "GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188" status: 200 len: 1315 microversion: 2.1 time: 0.333040 Jul 15 20:37:36.266563 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 47/95] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:35 2022] GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188 => generated 1315 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:36.273527 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-fbd96069-97bc-42ca-a820-e4425cb81271 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:36.274233 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-fbd96069-97bc-42ca-a820-e4425cb81271 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:36.275859 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-fbd96069-97bc-42ca-a820-e4425cb81271 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:36.276506 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-fbd96069-97bc-42ca-a820-e4425cb81271 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:36.470977 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-fbd96069-97bc-42ca-a820-e4425cb81271 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:36.479522 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-fbd96069-97bc-42ca-a820-e4425cb81271 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d" status: 200 len: 1366 microversion: 2.1 time: 0.232572 Jul 15 20:37:36.484305 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 49/96] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:36 2022] GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d => generated 1366 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:36.676988 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-e007ce6e-4cb5-4485-b563-aa16fba61449 req-c04b3b31-11c0-4afa-ae23-a816336f57e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48c34b54-0234-4763-a6c1-f73c3c075277", "name": "network-vif-plugged", "status": "completed", "tag": "f430e1bb-7731-410f-ac4d-4f4b0b340704"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:37:36.685251 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-e007ce6e-4cb5-4485-b563-aa16fba61449 req-c04b3b31-11c0-4afa-ae23-a816336f57e0 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:36.685779 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-e007ce6e-4cb5-4485-b563-aa16fba61449 req-c04b3b31-11c0-4afa-ae23-a816336f57e0 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:36.698717 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-e007ce6e-4cb5-4485-b563-aa16fba61449 req-c04b3b31-11c0-4afa-ae23-a816336f57e0 service nova] Creating event network-vif-plugged:f430e1bb-7731-410f-ac4d-4f4b0b340704 for instance 48c34b54-0234-4763-a6c1-f73c3c075277 on hv-cinder-79987 Jul 15 20:37:36.704607 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-e007ce6e-4cb5-4485-b563-aa16fba61449 req-c04b3b31-11c0-4afa-ae23-a816336f57e0 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096686 Jul 15 20:37:36.706547 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 48/97] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:37:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:37:37.261219 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-203286b6-0a00-44ef-8411-bcf7a2d4acdd tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:37.262096 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-203286b6-0a00-44ef-8411-bcf7a2d4acdd tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:37.268442 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-203286b6-0a00-44ef-8411-bcf7a2d4acdd tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:37.269214 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-203286b6-0a00-44ef-8411-bcf7a2d4acdd tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:37.270277 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-203286b6-0a00-44ef-8411-bcf7a2d4acdd tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:37.271038 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-203286b6-0a00-44ef-8411-bcf7a2d4acdd tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:37.301173 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-8793bda2-9da6-4318-bbe3-8f4aa1427990 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:37.301986 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-8793bda2-9da6-4318-bbe3-8f4aa1427990 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] [instance: 31e74255-0b4d-4c43-91ce-ffccffdc2188] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:37.310969 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8793bda2-9da6-4318-bbe3-8f4aa1427990 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:37.311491 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8793bda2-9da6-4318-bbe3-8f4aa1427990 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:37.312348 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8793bda2-9da6-4318-bbe3-8f4aa1427990 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:37.312879 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8793bda2-9da6-4318-bbe3-8f4aa1427990 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:37.566429 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-203286b6-0a00-44ef-8411-bcf7a2d4acdd tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:37.574634 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-8793bda2-9da6-4318-bbe3-8f4aa1427990 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f231f706d2f4d3e9070105bb5981cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f12afd420d4f6bad8e80207ea64d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:37.575935 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-203286b6-0a00-44ef-8411-bcf7a2d4acdd tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc" status: 200 len: 1322 microversion: 2.1 time: 0.319257 Jul 15 20:37:37.577461 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 50/98] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:37 2022] GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc => generated 1322 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:37:37.584617 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-8793bda2-9da6-4318-bbe3-8f4aa1427990 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] 10.222.0.66 "GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188" status: 200 len: 1315 microversion: 2.1 time: 0.303332 Jul 15 20:37:37.587760 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-3592e1bc-93af-46fc-8f03-14092e676096 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:37.588473 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-3592e1bc-93af-46fc-8f03-14092e676096 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: f45998cc-d9ed-4dd5-acf0-caba5d56696d] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:37.590581 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 49/99] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:37 2022] GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188 => generated 1315 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:37.599633 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-3592e1bc-93af-46fc-8f03-14092e676096 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:37.599633 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-3592e1bc-93af-46fc-8f03-14092e676096 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:37.599633 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-3592e1bc-93af-46fc-8f03-14092e676096 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:37.599633 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-3592e1bc-93af-46fc-8f03-14092e676096 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:37.734087 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-3592e1bc-93af-46fc-8f03-14092e676096 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:37.742276 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-3592e1bc-93af-46fc-8f03-14092e676096 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d" status: 200 len: 1366 microversion: 2.1 time: 0.163333 Jul 15 20:37:37.742844 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 51/100] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:37 2022] GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:38.594170 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-278e12d4-9f7f-4294-aa1d-dab891f6e1a6 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:38.595024 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-278e12d4-9f7f-4294-aa1d-dab891f6e1a6 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:38.602226 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-278e12d4-9f7f-4294-aa1d-dab891f6e1a6 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:38.602761 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-278e12d4-9f7f-4294-aa1d-dab891f6e1a6 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:38.603627 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-278e12d4-9f7f-4294-aa1d-dab891f6e1a6 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:38.604133 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-278e12d4-9f7f-4294-aa1d-dab891f6e1a6 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:38.607189 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-0db523f3-e467-44dc-bf96-374033a867a2 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:38.607788 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-0db523f3-e467-44dc-bf96-374033a867a2 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] [instance: 31e74255-0b4d-4c43-91ce-ffccffdc2188] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:38.614535 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-0db523f3-e467-44dc-bf96-374033a867a2 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:38.614980 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-0db523f3-e467-44dc-bf96-374033a867a2 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:38.615754 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-0db523f3-e467-44dc-bf96-374033a867a2 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:38.616189 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-0db523f3-e467-44dc-bf96-374033a867a2 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:38.811455 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-278e12d4-9f7f-4294-aa1d-dab891f6e1a6 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:38.815123 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-0db523f3-e467-44dc-bf96-374033a867a2 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f231f706d2f4d3e9070105bb5981cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f12afd420d4f6bad8e80207ea64d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:38.821078 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-278e12d4-9f7f-4294-aa1d-dab891f6e1a6 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc" status: 200 len: 1322 microversion: 2.1 time: 0.230721 Jul 15 20:37:38.823699 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-0db523f3-e467-44dc-bf96-374033a867a2 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] 10.222.0.66 "GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188" status: 200 len: 1315 microversion: 2.1 time: 0.220455 Jul 15 20:37:38.824501 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 52/101] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:38 2022] GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188 => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:37:38.831057 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [req-8cef8948-1664-4237-a45d-1d75bbf37a0e req-d301a4c3-ae63-41c9-a119-050ac6ccb423 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f45998cc-d9ed-4dd5-acf0-caba5d56696d", "name": "network-vif-plugged", "status": "completed", "tag": "af14f3e2-18e6-4ff3-b57f-afda50ef445b"}, {"server_uuid": "31e74255-0b4d-4c43-91ce-ffccffdc2188", "name": "network-vif-plugged", "status": "completed", "tag": "e782e7a7-19dc-48bb-8058-13652a1a4b65"}]} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:37:38.832173 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 50/102] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:38 2022] GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc => generated 1322 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:37:38.836991 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-d69a6814-0bbb-4235-97a1-7f46f9d9aac1 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:38.837602 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-d69a6814-0bbb-4235-97a1-7f46f9d9aac1 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: f45998cc-d9ed-4dd5-acf0-caba5d56696d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:38.841609 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-8cef8948-1664-4237-a45d-1d75bbf37a0e req-d301a4c3-ae63-41c9-a119-050ac6ccb423 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:38.842275 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-8cef8948-1664-4237-a45d-1d75bbf37a0e req-d301a4c3-ae63-41c9-a119-050ac6ccb423 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:38.844593 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d69a6814-0bbb-4235-97a1-7f46f9d9aac1 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:38.845361 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d69a6814-0bbb-4235-97a1-7f46f9d9aac1 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:38.847095 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d69a6814-0bbb-4235-97a1-7f46f9d9aac1 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:38.847704 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d69a6814-0bbb-4235-97a1-7f46f9d9aac1 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:38.857117 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.compute.server_external_events [req-8cef8948-1664-4237-a45d-1d75bbf37a0e req-d301a4c3-ae63-41c9-a119-050ac6ccb423 service nova] Creating event network-vif-plugged:af14f3e2-18e6-4ff3-b57f-afda50ef445b for instance f45998cc-d9ed-4dd5-acf0-caba5d56696d on hv-cinder-79987 Jul 15 20:37:38.857993 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.compute.server_external_events [req-8cef8948-1664-4237-a45d-1d75bbf37a0e req-d301a4c3-ae63-41c9-a119-050ac6ccb423 service nova] Creating event network-vif-plugged:e782e7a7-19dc-48bb-8058-13652a1a4b65 for instance 31e74255-0b4d-4c43-91ce-ffccffdc2188 on hv-cinder-79987 Jul 15 20:37:38.864810 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [req-8cef8948-1664-4237-a45d-1d75bbf37a0e req-d301a4c3-ae63-41c9-a119-050ac6ccb423 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038877 Jul 15 20:37:38.865413 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 53/103] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:37:38 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:37:38.987429 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-d69a6814-0bbb-4235-97a1-7f46f9d9aac1 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:38.994985 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-d69a6814-0bbb-4235-97a1-7f46f9d9aac1 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d" status: 200 len: 1366 microversion: 2.1 time: 0.161739 Jul 15 20:37:38.995566 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 51/104] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:38 2022] GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:39.839601 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-88785d54-2bdb-432e-a4c8-5b6a3a0adef0 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:39.840222 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-88785d54-2bdb-432e-a4c8-5b6a3a0adef0 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:39.840812 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-c0f474ce-aece-4e9a-b4d7-85e6a82848c1 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:39.841445 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-c0f474ce-aece-4e9a-b4d7-85e6a82848c1 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] [instance: 31e74255-0b4d-4c43-91ce-ffccffdc2188] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:39.847225 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-88785d54-2bdb-432e-a4c8-5b6a3a0adef0 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:39.847701 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-88785d54-2bdb-432e-a4c8-5b6a3a0adef0 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:39.848507 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-88785d54-2bdb-432e-a4c8-5b6a3a0adef0 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:39.848947 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-88785d54-2bdb-432e-a4c8-5b6a3a0adef0 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:39.849110 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c0f474ce-aece-4e9a-b4d7-85e6a82848c1 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:39.849827 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c0f474ce-aece-4e9a-b4d7-85e6a82848c1 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:39.850604 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c0f474ce-aece-4e9a-b4d7-85e6a82848c1 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:39.851048 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c0f474ce-aece-4e9a-b4d7-85e6a82848c1 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:40.066958 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-c0f474ce-aece-4e9a-b4d7-85e6a82848c1 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f231f706d2f4d3e9070105bb5981cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f12afd420d4f6bad8e80207ea64d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:40.074373 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-c0f474ce-aece-4e9a-b4d7-85e6a82848c1 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] 10.222.0.66 "GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188" status: 200 len: 1315 microversion: 2.1 time: 0.237270 Jul 15 20:37:40.075306 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 52/105] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:39 2022] GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188 => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:37:40.088169 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-b41eac63-ec9a-4300-be17-2e4d45ae3912 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:40.088821 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-b41eac63-ec9a-4300-be17-2e4d45ae3912 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: f45998cc-d9ed-4dd5-acf0-caba5d56696d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:40.091077 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-88785d54-2bdb-432e-a4c8-5b6a3a0adef0 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:40.094975 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b41eac63-ec9a-4300-be17-2e4d45ae3912 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:40.096235 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b41eac63-ec9a-4300-be17-2e4d45ae3912 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:40.097151 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b41eac63-ec9a-4300-be17-2e4d45ae3912 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:40.097585 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b41eac63-ec9a-4300-be17-2e4d45ae3912 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:40.100024 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-88785d54-2bdb-432e-a4c8-5b6a3a0adef0 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc" status: 200 len: 1322 microversion: 2.1 time: 0.264664 Jul 15 20:37:40.100633 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 54/106] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:39 2022] GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc => generated 1322 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:40.233739 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-b41eac63-ec9a-4300-be17-2e4d45ae3912 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:40.244269 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-b41eac63-ec9a-4300-be17-2e4d45ae3912 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d" status: 200 len: 1366 microversion: 2.1 time: 0.167768 Jul 15 20:37:40.245118 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 53/107] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:40 2022] GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:41.093006 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-e8467bc6-b3ce-4c1a-b7ae-cb408eef5542 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:41.093626 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-e8467bc6-b3ce-4c1a-b7ae-cb408eef5542 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] [instance: 31e74255-0b4d-4c43-91ce-ffccffdc2188] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:41.100340 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e8467bc6-b3ce-4c1a-b7ae-cb408eef5542 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:41.100837 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e8467bc6-b3ce-4c1a-b7ae-cb408eef5542 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:41.101597 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e8467bc6-b3ce-4c1a-b7ae-cb408eef5542 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:41.102031 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e8467bc6-b3ce-4c1a-b7ae-cb408eef5542 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:41.117233 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-9e5ce97b-a909-46dd-a9e1-efdab6c9e31e tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:41.118745 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-9e5ce97b-a909-46dd-a9e1-efdab6c9e31e tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:41.126136 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9e5ce97b-a909-46dd-a9e1-efdab6c9e31e tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:41.126586 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9e5ce97b-a909-46dd-a9e1-efdab6c9e31e tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:41.127443 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9e5ce97b-a909-46dd-a9e1-efdab6c9e31e tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:41.127876 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9e5ce97b-a909-46dd-a9e1-efdab6c9e31e tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:41.302895 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-e8467bc6-b3ce-4c1a-b7ae-cb408eef5542 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f231f706d2f4d3e9070105bb5981cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f12afd420d4f6bad8e80207ea64d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:41.311237 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-e8467bc6-b3ce-4c1a-b7ae-cb408eef5542 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] 10.222.0.66 "GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188" status: 200 len: 1315 microversion: 2.1 time: 0.221967 Jul 15 20:37:41.311804 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 55/108] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:41 2022] GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188 => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:41.318232 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-1eb84ca7-79c1-4838-a394-c6ea92f6a0c8 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:41.318835 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-1eb84ca7-79c1-4838-a394-c6ea92f6a0c8 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: f45998cc-d9ed-4dd5-acf0-caba5d56696d] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:41.325471 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-1eb84ca7-79c1-4838-a394-c6ea92f6a0c8 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:41.325918 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-1eb84ca7-79c1-4838-a394-c6ea92f6a0c8 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:41.326682 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-1eb84ca7-79c1-4838-a394-c6ea92f6a0c8 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:41.327246 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-1eb84ca7-79c1-4838-a394-c6ea92f6a0c8 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:41.330363 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-9e5ce97b-a909-46dd-a9e1-efdab6c9e31e tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:41.339714 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-9e5ce97b-a909-46dd-a9e1-efdab6c9e31e tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc" status: 200 len: 1322 microversion: 2.1 time: 0.226334 Jul 15 20:37:41.351254 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 54/109] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:41 2022] GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc => generated 1322 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:37:41.482547 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-1eb84ca7-79c1-4838-a394-c6ea92f6a0c8 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:41.494432 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-1eb84ca7-79c1-4838-a394-c6ea92f6a0c8 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d" status: 200 len: 1366 microversion: 2.1 time: 0.181538 Jul 15 20:37:41.495084 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 56/110] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:41 2022] GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:42.329390 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-af994342-3dfb-4be6-8b7d-b726bba6ff67 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:42.331996 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-af994342-3dfb-4be6-8b7d-b726bba6ff67 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] [instance: 31e74255-0b4d-4c43-91ce-ffccffdc2188] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:42.358180 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-d433527d-6529-41bb-a625-1c8d9a850fda tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:42.359116 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-d433527d-6529-41bb-a625-1c8d9a850fda tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:42.372381 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-af994342-3dfb-4be6-8b7d-b726bba6ff67 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:42.374787 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-af994342-3dfb-4be6-8b7d-b726bba6ff67 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:42.380997 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d433527d-6529-41bb-a625-1c8d9a850fda tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:42.381499 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-af994342-3dfb-4be6-8b7d-b726bba6ff67 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:42.382124 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-af994342-3dfb-4be6-8b7d-b726bba6ff67 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:42.383669 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d433527d-6529-41bb-a625-1c8d9a850fda tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:42.386705 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d433527d-6529-41bb-a625-1c8d9a850fda tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:42.391150 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d433527d-6529-41bb-a625-1c8d9a850fda tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:42.712355 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-af994342-3dfb-4be6-8b7d-b726bba6ff67 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f231f706d2f4d3e9070105bb5981cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f12afd420d4f6bad8e80207ea64d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:42.721182 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-af994342-3dfb-4be6-8b7d-b726bba6ff67 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] 10.222.0.66 "GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188" status: 200 len: 1315 microversion: 2.1 time: 0.395573 Jul 15 20:37:42.722355 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 55/111] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:42 2022] GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188 => generated 1315 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:42.727137 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-12c5943c-ca2b-4113-b9e8-ca4b446dcf1c req-145cb0ef-2c5e-46ca-805c-50269cb99fba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef881276-4314-4f71-8f0e-195af41473bc", "name": "network-vif-plugged", "status": "completed", "tag": "d7772a75-e1a3-43d1-9412-92dff1189079"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:37:42.732506 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-d433527d-6529-41bb-a625-1c8d9a850fda tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:42.735548 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-12c5943c-ca2b-4113-b9e8-ca4b446dcf1c req-145cb0ef-2c5e-46ca-805c-50269cb99fba service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:42.736600 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-12c5943c-ca2b-4113-b9e8-ca4b446dcf1c req-145cb0ef-2c5e-46ca-805c-50269cb99fba service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:42.743613 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-d433527d-6529-41bb-a625-1c8d9a850fda tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc" status: 200 len: 1322 microversion: 2.1 time: 0.389807 Jul 15 20:37:42.744515 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 57/112] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:42 2022] GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc => generated 1322 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:42.748355 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-12c5943c-ca2b-4113-b9e8-ca4b446dcf1c req-145cb0ef-2c5e-46ca-805c-50269cb99fba service nova] Creating event network-vif-plugged:d7772a75-e1a3-43d1-9412-92dff1189079 for instance ef881276-4314-4f71-8f0e-195af41473bc on hv-cinder-79987 Jul 15 20:37:42.754720 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-12c5943c-ca2b-4113-b9e8-ca4b446dcf1c req-145cb0ef-2c5e-46ca-805c-50269cb99fba service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031034 Jul 15 20:37:42.756994 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 56/113] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:37:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:37:42.759552 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-6184abd1-e338-4e63-95be-9f754bed0b78 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:42.760172 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-6184abd1-e338-4e63-95be-9f754bed0b78 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: f45998cc-d9ed-4dd5-acf0-caba5d56696d] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:42.766470 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-6184abd1-e338-4e63-95be-9f754bed0b78 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:42.766974 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-6184abd1-e338-4e63-95be-9f754bed0b78 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:42.767745 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-6184abd1-e338-4e63-95be-9f754bed0b78 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:42.768169 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-6184abd1-e338-4e63-95be-9f754bed0b78 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:42.916552 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-6184abd1-e338-4e63-95be-9f754bed0b78 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:42.925073 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-6184abd1-e338-4e63-95be-9f754bed0b78 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d" status: 200 len: 1366 microversion: 2.1 time: 0.171614 Jul 15 20:37:42.925678 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 58/114] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:42 2022] GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:43.741563 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-c2f38212-93d6-4e80-8e01-bb0c157be728 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:43.742288 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-c2f38212-93d6-4e80-8e01-bb0c157be728 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] [instance: 31e74255-0b4d-4c43-91ce-ffccffdc2188] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:43.749526 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c2f38212-93d6-4e80-8e01-bb0c157be728 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:43.749961 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c2f38212-93d6-4e80-8e01-bb0c157be728 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:43.750730 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c2f38212-93d6-4e80-8e01-bb0c157be728 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:43.751165 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c2f38212-93d6-4e80-8e01-bb0c157be728 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:43.763117 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-0c93f2cf-e850-4866-b832-6fa1a15351b9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:43.763726 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-0c93f2cf-e850-4866-b832-6fa1a15351b9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:43.770921 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-0c93f2cf-e850-4866-b832-6fa1a15351b9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:43.771379 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-0c93f2cf-e850-4866-b832-6fa1a15351b9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:43.772149 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-0c93f2cf-e850-4866-b832-6fa1a15351b9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:43.772620 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-0c93f2cf-e850-4866-b832-6fa1a15351b9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:43.970176 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-c2f38212-93d6-4e80-8e01-bb0c157be728 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f231f706d2f4d3e9070105bb5981cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f12afd420d4f6bad8e80207ea64d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:43.977112 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-0c93f2cf-e850-4866-b832-6fa1a15351b9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:43.978537 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-c2f38212-93d6-4e80-8e01-bb0c157be728 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] 10.222.0.66 "GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188" status: 200 len: 1315 microversion: 2.1 time: 0.242570 Jul 15 20:37:43.979237 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 57/115] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:43 2022] GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188 => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:43.983690 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-f06b1635-fdcb-46e8-abb2-992c4f517558 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:43.984292 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-f06b1635-fdcb-46e8-abb2-992c4f517558 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: f45998cc-d9ed-4dd5-acf0-caba5d56696d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:43.985028 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-0c93f2cf-e850-4866-b832-6fa1a15351b9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc" status: 200 len: 1322 microversion: 2.1 time: 0.225721 Jul 15 20:37:43.985582 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 59/116] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:43 2022] GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc => generated 1322 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:37:43.992095 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f06b1635-fdcb-46e8-abb2-992c4f517558 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:43.992579 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f06b1635-fdcb-46e8-abb2-992c4f517558 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:43.993588 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f06b1635-fdcb-46e8-abb2-992c4f517558 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:43.994445 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f06b1635-fdcb-46e8-abb2-992c4f517558 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:44.136341 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-f06b1635-fdcb-46e8-abb2-992c4f517558 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:44.146813 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-f06b1635-fdcb-46e8-abb2-992c4f517558 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d" status: 200 len: 1366 microversion: 2.1 time: 0.166574 Jul 15 20:37:44.147463 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 58/117] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:43 2022] GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:44.996133 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-81991619-295a-493c-8d5f-c0b229780dcc tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:44.996987 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-81991619-295a-493c-8d5f-c0b229780dcc tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] [instance: 31e74255-0b4d-4c43-91ce-ffccffdc2188] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:45.002076 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-2df3ee6e-240b-4415-ab4a-71673286e942 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:45.002707 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-2df3ee6e-240b-4415-ab4a-71673286e942 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:45.004364 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-81991619-295a-493c-8d5f-c0b229780dcc tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:45.004841 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-81991619-295a-493c-8d5f-c0b229780dcc tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:45.005617 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-81991619-295a-493c-8d5f-c0b229780dcc tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:45.006051 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-81991619-295a-493c-8d5f-c0b229780dcc tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:45.009188 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2df3ee6e-240b-4415-ab4a-71673286e942 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:45.009626 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2df3ee6e-240b-4415-ab4a-71673286e942 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:45.010587 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2df3ee6e-240b-4415-ab4a-71673286e942 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:45.011025 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2df3ee6e-240b-4415-ab4a-71673286e942 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:45.027241 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_cell1:SELECT=100 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:45.218217 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-81991619-295a-493c-8d5f-c0b229780dcc tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f231f706d2f4d3e9070105bb5981cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f12afd420d4f6bad8e80207ea64d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:45.226762 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-81991619-295a-493c-8d5f-c0b229780dcc tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] 10.222.0.66 "GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188" status: 200 len: 1315 microversion: 2.1 time: 0.234514 Jul 15 20:37:45.227488 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 60/118] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:44 2022] GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188 => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:45.228543 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-2df3ee6e-240b-4415-ab4a-71673286e942 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:45.232858 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell1:SELECT=100 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:45.238647 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-2df3ee6e-240b-4415-ab4a-71673286e942 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc" status: 200 len: 1322 microversion: 2.1 time: 0.240507 Jul 15 20:37:45.239435 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 59/119] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:44 2022] GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc => generated 1322 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:45.241432 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-7565fc46-baf6-44d4-b7ea-a1bc24d82797 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:45.242949 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-7565fc46-baf6-44d4-b7ea-a1bc24d82797 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: f45998cc-d9ed-4dd5-acf0-caba5d56696d] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:45.252692 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-7565fc46-baf6-44d4-b7ea-a1bc24d82797 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:45.253300 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-7565fc46-baf6-44d4-b7ea-a1bc24d82797 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:45.254100 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-7565fc46-baf6-44d4-b7ea-a1bc24d82797 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:45.254540 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-7565fc46-baf6-44d4-b7ea-a1bc24d82797 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:45.389818 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-7565fc46-baf6-44d4-b7ea-a1bc24d82797 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:45.397664 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-7565fc46-baf6-44d4-b7ea-a1bc24d82797 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d" status: 200 len: 1366 microversion: 2.1 time: 0.168974 Jul 15 20:37:45.398233 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 61/120] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:45 2022] GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:46.246279 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-951de93f-e780-4152-bdb1-0647cdb05b4e tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:46.247000 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-951de93f-e780-4152-bdb1-0647cdb05b4e tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] [instance: 31e74255-0b4d-4c43-91ce-ffccffdc2188] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:46.254231 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-951de93f-e780-4152-bdb1-0647cdb05b4e tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:46.255040 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-951de93f-e780-4152-bdb1-0647cdb05b4e tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:46.255815 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-35dbdd36-a4d1-4532-9824-8a4629114424 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:46.256263 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-951de93f-e780-4152-bdb1-0647cdb05b4e tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:46.256528 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-951de93f-e780-4152-bdb1-0647cdb05b4e tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:46.256638 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-35dbdd36-a4d1-4532-9824-8a4629114424 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:46.265276 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-35dbdd36-a4d1-4532-9824-8a4629114424 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:46.266034 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-35dbdd36-a4d1-4532-9824-8a4629114424 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:46.267479 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-35dbdd36-a4d1-4532-9824-8a4629114424 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:46.268001 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-35dbdd36-a4d1-4532-9824-8a4629114424 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:46.477534 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-951de93f-e780-4152-bdb1-0647cdb05b4e tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f231f706d2f4d3e9070105bb5981cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f12afd420d4f6bad8e80207ea64d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:46.484892 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-35dbdd36-a4d1-4532-9824-8a4629114424 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:46.485555 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-951de93f-e780-4152-bdb1-0647cdb05b4e tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] 10.222.0.66 "GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188" status: 200 len: 1315 microversion: 2.1 time: 0.243733 Jul 15 20:37:46.486347 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 60/121] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:46 2022] GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188 => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:46.493521 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-35dbdd36-a4d1-4532-9824-8a4629114424 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc" status: 200 len: 1322 microversion: 2.1 time: 0.242145 Jul 15 20:37:46.494076 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 62/122] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:46 2022] GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc => generated 1322 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:46.498847 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-d5507fa4-7624-460b-a4b2-021fe5fba7a8 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:46.499463 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-d5507fa4-7624-460b-a4b2-021fe5fba7a8 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: f45998cc-d9ed-4dd5-acf0-caba5d56696d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:46.506075 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d5507fa4-7624-460b-a4b2-021fe5fba7a8 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:46.506521 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d5507fa4-7624-460b-a4b2-021fe5fba7a8 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:46.508547 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d5507fa4-7624-460b-a4b2-021fe5fba7a8 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:46.508547 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d5507fa4-7624-460b-a4b2-021fe5fba7a8 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:46.646856 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-d5507fa4-7624-460b-a4b2-021fe5fba7a8 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:46.654616 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-d5507fa4-7624-460b-a4b2-021fe5fba7a8 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d" status: 200 len: 1366 microversion: 2.1 time: 0.167064 Jul 15 20:37:46.655280 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 61/123] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:46 2022] GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:47.502722 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-34863332-ab72-4106-baec-fe801a3b8995 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:47.503326 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-34863332-ab72-4106-baec-fe801a3b8995 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] [instance: 31e74255-0b4d-4c43-91ce-ffccffdc2188] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:47.509631 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-d1e94bde-6b89-4203-b67c-2dc9569f56d8 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:47.510115 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-34863332-ab72-4106-baec-fe801a3b8995 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:47.510115 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-34863332-ab72-4106-baec-fe801a3b8995 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:47.510326 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-d1e94bde-6b89-4203-b67c-2dc9569f56d8 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:47.510850 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-34863332-ab72-4106-baec-fe801a3b8995 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:47.511275 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-34863332-ab72-4106-baec-fe801a3b8995 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:47.519298 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d1e94bde-6b89-4203-b67c-2dc9569f56d8 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:47.519523 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d1e94bde-6b89-4203-b67c-2dc9569f56d8 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:47.520550 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d1e94bde-6b89-4203-b67c-2dc9569f56d8 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:47.521159 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d1e94bde-6b89-4203-b67c-2dc9569f56d8 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:47.717658 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-34863332-ab72-4106-baec-fe801a3b8995 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f231f706d2f4d3e9070105bb5981cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f12afd420d4f6bad8e80207ea64d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:47.722657 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-d1e94bde-6b89-4203-b67c-2dc9569f56d8 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:47.725739 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-34863332-ab72-4106-baec-fe801a3b8995 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] 10.222.0.66 "GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188" status: 200 len: 1315 microversion: 2.1 time: 0.227397 Jul 15 20:37:47.726306 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 63/124] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:47 2022] GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188 => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:47.730080 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-d1e94bde-6b89-4203-b67c-2dc9569f56d8 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc" status: 200 len: 1322 microversion: 2.1 time: 0.224307 Jul 15 20:37:47.730748 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 62/125] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:47 2022] GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:37:47.730881 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-acff4383-d1f2-4543-8e6f-05b77a45dc19 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:47.731367 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-acff4383-d1f2-4543-8e6f-05b77a45dc19 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: f45998cc-d9ed-4dd5-acf0-caba5d56696d] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:47.737664 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-acff4383-d1f2-4543-8e6f-05b77a45dc19 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:47.738104 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-acff4383-d1f2-4543-8e6f-05b77a45dc19 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:47.738850 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-acff4383-d1f2-4543-8e6f-05b77a45dc19 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:47.739311 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-acff4383-d1f2-4543-8e6f-05b77a45dc19 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:47.869487 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-acff4383-d1f2-4543-8e6f-05b77a45dc19 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:47.876893 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-acff4383-d1f2-4543-8e6f-05b77a45dc19 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d" status: 200 len: 1366 microversion: 2.1 time: 0.149570 Jul 15 20:37:47.877473 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 64/126] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:47 2022] GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:48.743184 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-9b30776b-4a8e-4fbd-adc0-17549f25b5fa tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:48.744052 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-9b30776b-4a8e-4fbd-adc0-17549f25b5fa tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] [instance: 31e74255-0b4d-4c43-91ce-ffccffdc2188] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:48.753737 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9b30776b-4a8e-4fbd-adc0-17549f25b5fa tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:48.754550 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9b30776b-4a8e-4fbd-adc0-17549f25b5fa tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:48.755572 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9b30776b-4a8e-4fbd-adc0-17549f25b5fa tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:48.756772 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9b30776b-4a8e-4fbd-adc0-17549f25b5fa tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:48.763008 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-7a6d4560-8cc9-4f2b-99a2-1db305edf3e6 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:48.763670 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-7a6d4560-8cc9-4f2b-99a2-1db305edf3e6 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:48.772723 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-7a6d4560-8cc9-4f2b-99a2-1db305edf3e6 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:48.773540 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-7a6d4560-8cc9-4f2b-99a2-1db305edf3e6 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:48.774302 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-7a6d4560-8cc9-4f2b-99a2-1db305edf3e6 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:48.774886 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-7a6d4560-8cc9-4f2b-99a2-1db305edf3e6 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:48.961231 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-9b30776b-4a8e-4fbd-adc0-17549f25b5fa tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f231f706d2f4d3e9070105bb5981cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f12afd420d4f6bad8e80207ea64d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:48.970403 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-9b30776b-4a8e-4fbd-adc0-17549f25b5fa tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] 10.222.0.66 "GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188" status: 200 len: 1502 microversion: 2.1 time: 0.230541 Jul 15 20:37:48.971204 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 63/127] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:48 2022] GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188 => generated 1502 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:48.986693 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-7a6d4560-8cc9-4f2b-99a2-1db305edf3e6 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:48.990482 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-7239d9f8-4805-481f-81e2-9a3c57446960 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:48.991181 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-7239d9f8-4805-481f-81e2-9a3c57446960 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: f45998cc-d9ed-4dd5-acf0-caba5d56696d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:48.997761 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7239d9f8-4805-481f-81e2-9a3c57446960 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:48.998310 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7239d9f8-4805-481f-81e2-9a3c57446960 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:48.999183 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7239d9f8-4805-481f-81e2-9a3c57446960 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:48.999704 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7239d9f8-4805-481f-81e2-9a3c57446960 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:49.000065 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-7a6d4560-8cc9-4f2b-99a2-1db305edf3e6 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc" status: 200 len: 1322 microversion: 2.1 time: 0.252791 Jul 15 20:37:49.001414 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 65/128] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:48 2022] GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc => generated 1322 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:49.151308 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-7239d9f8-4805-481f-81e2-9a3c57446960 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:49.159538 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-7239d9f8-4805-481f-81e2-9a3c57446960 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d" status: 200 len: 1556 microversion: 2.1 time: 0.174725 Jul 15 20:37:49.160105 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 64/129] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:48 2022] GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d => generated 1556 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:49.176645 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-ad367beb-c07c-4a96-aebc-9c602529b9d5 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:49.177141 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-ad367beb-c07c-4a96-aebc-9c602529b9d5 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: f45998cc-d9ed-4dd5-acf0-caba5d56696d] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:49.183172 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-ad367beb-c07c-4a96-aebc-9c602529b9d5 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:49.183655 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-ad367beb-c07c-4a96-aebc-9c602529b9d5 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:49.184810 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-ad367beb-c07c-4a96-aebc-9c602529b9d5 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:49.185561 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-ad367beb-c07c-4a96-aebc-9c602529b9d5 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:49.326271 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-ad367beb-c07c-4a96-aebc-9c602529b9d5 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.153510 Jul 15 20:37:49.333846 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 66/130] 10.222.0.66 () {58 vars in 1274 bytes} [Fri Jul 15 20:37:49 2022] GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d/os-interface => generated 284 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:37:50.018045 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-ce4bcf05-82cf-48ce-afd1-87ce1cbcb67d tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:50.019634 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-ce4bcf05-82cf-48ce-afd1-87ce1cbcb67d tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:50.041685 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ce4bcf05-82cf-48ce-afd1-87ce1cbcb67d tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:50.042482 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ce4bcf05-82cf-48ce-afd1-87ce1cbcb67d tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:50.043169 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ce4bcf05-82cf-48ce-afd1-87ce1cbcb67d tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:50.043771 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ce4bcf05-82cf-48ce-afd1-87ce1cbcb67d tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:50.474507 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-ce4bcf05-82cf-48ce-afd1-87ce1cbcb67d tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:50.481922 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-ce4bcf05-82cf-48ce-afd1-87ce1cbcb67d tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc" status: 200 len: 1322 microversion: 2.1 time: 0.468382 Jul 15 20:37:50.482489 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 65/131] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:50 2022] GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc => generated 1322 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:50.548060 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-301a7bd3-073a-4789-a6b6-fe595b5c4a41 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "038af314-e7e2-469b-82a3-783b2346ba25"}} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:37:50.551400 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-301a7bd3-073a-4789-a6b6-fe595b5c4a41 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] [instance: 31e74255-0b4d-4c43-91ce-ffccffdc2188] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:50.560124 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-301a7bd3-073a-4789-a6b6-fe595b5c4a41 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:50.560883 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-301a7bd3-073a-4789-a6b6-fe595b5c4a41 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:50.562260 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-301a7bd3-073a-4789-a6b6-fe595b5c4a41 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:50.562905 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-301a7bd3-073a-4789-a6b6-fe595b5c4a41 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:50.998043 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-ba06d2b1-2c60-4823-9dcc-10a3d3db1720 req-60679a67-7e3c-4698-9629-095f4eab83af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f45998cc-d9ed-4dd5-acf0-caba5d56696d", "tag": "af14f3e2-18e6-4ff3-b57f-afda50ef445b"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:37:51.006194 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-ba06d2b1-2c60-4823-9dcc-10a3d3db1720 req-60679a67-7e3c-4698-9629-095f4eab83af service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:51.006624 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-ba06d2b1-2c60-4823-9dcc-10a3d3db1720 req-60679a67-7e3c-4698-9629-095f4eab83af service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:51.018876 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-ba06d2b1-2c60-4823-9dcc-10a3d3db1720 req-60679a67-7e3c-4698-9629-095f4eab83af service nova] Creating event network-changed:af14f3e2-18e6-4ff3-b57f-afda50ef445b for instance f45998cc-d9ed-4dd5-acf0-caba5d56696d on hv-cinder-79987 Jul 15 20:37:51.024084 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-ba06d2b1-2c60-4823-9dcc-10a3d3db1720 req-60679a67-7e3c-4698-9629-095f4eab83af service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029652 Jul 15 20:37:51.024981 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 66/132] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:37:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 20:37:51.502539 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-ee197357-24d4-4a65-af6d-07d4e74b21ec tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:51.503283 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-ee197357-24d4-4a65-af6d-07d4e74b21ec tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:51.509647 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ee197357-24d4-4a65-af6d-07d4e74b21ec tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:51.510094 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ee197357-24d4-4a65-af6d-07d4e74b21ec tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:51.510864 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ee197357-24d4-4a65-af6d-07d4e74b21ec tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:51.511298 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ee197357-24d4-4a65-af6d-07d4e74b21ec tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:51.643125 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-ee197357-24d4-4a65-af6d-07d4e74b21ec tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:51.650495 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-ee197357-24d4-4a65-af6d-07d4e74b21ec tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc" status: 200 len: 1322 microversion: 2.1 time: 0.153972 Jul 15 20:37:51.651064 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 67/133] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:51 2022] GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:37:52.669044 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-038822f3-1132-4224-bb67-c2baf0b5b66c tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:52.669908 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-038822f3-1132-4224-bb67-c2baf0b5b66c tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:52.671940 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_api:SELECT=74 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:52.677830 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-038822f3-1132-4224-bb67-c2baf0b5b66c tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:52.678281 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-038822f3-1132-4224-bb67-c2baf0b5b66c tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:52.679043 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-038822f3-1132-4224-bb67-c2baf0b5b66c tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:52.679473 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-038822f3-1132-4224-bb67-c2baf0b5b66c tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:52.806995 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-038822f3-1132-4224-bb67-c2baf0b5b66c tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:52.815086 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-038822f3-1132-4224-bb67-c2baf0b5b66c tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc" status: 200 len: 1322 microversion: 2.1 time: 0.151410 Jul 15 20:37:52.815647 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 68/134] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:52 2022] GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:37:53.537190 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-301a7bd3-073a-4789-a6b6-fe595b5c4a41 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] 10.222.0.66 "POST /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.993586 Jul 15 20:37:53.537862 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 67/135] 10.222.0.66 () {60 vars in 1322 bytes} [Fri Jul 15 20:37:50 2022] POST /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188/os-volume_attachments => generated 194 bytes in 2995 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 20:37:53.832129 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-99996b2f-449e-4716-9844-0e9e0eb936ac tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:53.832889 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-99996b2f-449e-4716-9844-0e9e0eb936ac tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:53.840094 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-99996b2f-449e-4716-9844-0e9e0eb936ac tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:53.841005 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-99996b2f-449e-4716-9844-0e9e0eb936ac tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:53.841803 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-99996b2f-449e-4716-9844-0e9e0eb936ac tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:53.842449 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-99996b2f-449e-4716-9844-0e9e0eb936ac tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:53.989604 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-99996b2f-449e-4716-9844-0e9e0eb936ac tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:53.998294 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-99996b2f-449e-4716-9844-0e9e0eb936ac tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc" status: 200 len: 1322 microversion: 2.1 time: 0.170747 Jul 15 20:37:53.998941 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 69/136] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:53 2022] GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:55.016615 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-38fac5c7-f3e0-407d-88eb-818a28af5bb2 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:55.018301 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-38fac5c7-f3e0-407d-88eb-818a28af5bb2 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:55.022152 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_api:SELECT=71 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:37:55.027018 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-38fac5c7-f3e0-407d-88eb-818a28af5bb2 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:55.027657 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-38fac5c7-f3e0-407d-88eb-818a28af5bb2 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:55.028732 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-38fac5c7-f3e0-407d-88eb-818a28af5bb2 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:55.029450 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-38fac5c7-f3e0-407d-88eb-818a28af5bb2 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:55.194727 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-38fac5c7-f3e0-407d-88eb-818a28af5bb2 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:55.202655 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-38fac5c7-f3e0-407d-88eb-818a28af5bb2 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc" status: 200 len: 1516 microversion: 2.1 time: 0.190835 Jul 15 20:37:55.203310 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 68/137] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:55 2022] GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc => generated 1516 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:55.221642 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-ad58baa6-5340-4ac6-ac28-8ded3fc2b78f tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:37:55.223639 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-ad58baa6-5340-4ac6-ac28-8ded3fc2b78f tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:55.230576 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ad58baa6-5340-4ac6-ac28-8ded3fc2b78f tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:55.231023 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ad58baa6-5340-4ac6-ac28-8ded3fc2b78f tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:55.231972 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ad58baa6-5340-4ac6-ac28-8ded3fc2b78f tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:55.232724 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ad58baa6-5340-4ac6-ac28-8ded3fc2b78f tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:55.308535 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.objects.instance [None req-ad58baa6-5340-4ac6-ac28-8ded3fc2b78f tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lazy-loading 'flavor' on Instance uuid ef881276-4314-4f71-8f0e-195af41473bc {{(pid=124432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 20:37:55.481641 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-ad58baa6-5340-4ac6-ac28-8ded3fc2b78f tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "POST /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc/action" status: 200 len: 32 microversion: 2.1 time: 0.265187 Jul 15 20:37:55.482745 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 70/138] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 15 20:37:55 2022] POST /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc/action => generated 32 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 15 20:37:55.501271 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-affce3f0-a621-4cf0-9d37-af7b4f9c70e7 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:55.503960 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-affce3f0-a621-4cf0-9d37-af7b4f9c70e7 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:55.523850 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-affce3f0-a621-4cf0-9d37-af7b4f9c70e7 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:55.525055 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-affce3f0-a621-4cf0-9d37-af7b4f9c70e7 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:55.526229 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-affce3f0-a621-4cf0-9d37-af7b4f9c70e7 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:55.539233 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-affce3f0-a621-4cf0-9d37-af7b4f9c70e7 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:55.855388 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-affce3f0-a621-4cf0-9d37-af7b4f9c70e7 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:55.865549 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-affce3f0-a621-4cf0-9d37-af7b4f9c70e7 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc" status: 200 len: 1522 microversion: 2.1 time: 0.374590 Jul 15 20:37:55.866421 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 69/139] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:55 2022] GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc => generated 1522 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:56.894009 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-a7cfe1b0-fe4d-4e07-98f9-2fef5434b43e tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:56.894939 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-a7cfe1b0-fe4d-4e07-98f9-2fef5434b43e tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:56.905610 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a7cfe1b0-fe4d-4e07-98f9-2fef5434b43e tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:56.911281 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a7cfe1b0-fe4d-4e07-98f9-2fef5434b43e tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:56.914712 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a7cfe1b0-fe4d-4e07-98f9-2fef5434b43e tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:56.916760 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a7cfe1b0-fe4d-4e07-98f9-2fef5434b43e tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:57.206240 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-a7cfe1b0-fe4d-4e07-98f9-2fef5434b43e tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:57.214174 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-a7cfe1b0-fe4d-4e07-98f9-2fef5434b43e tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc" status: 200 len: 1522 microversion: 2.1 time: 0.332745 Jul 15 20:37:57.226758 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 71/140] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:56 2022] GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc => generated 1522 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:58.232421 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-32ba84ab-75f7-40cb-8234-80c69b15849b tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:58.233247 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-32ba84ab-75f7-40cb-8234-80c69b15849b tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:58.241494 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-32ba84ab-75f7-40cb-8234-80c69b15849b tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:58.244044 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-32ba84ab-75f7-40cb-8234-80c69b15849b tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:58.247533 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-32ba84ab-75f7-40cb-8234-80c69b15849b tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:58.248330 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-32ba84ab-75f7-40cb-8234-80c69b15849b tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:58.432289 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-32ba84ab-75f7-40cb-8234-80c69b15849b tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:58.442646 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-32ba84ab-75f7-40cb-8234-80c69b15849b tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc" status: 200 len: 1522 microversion: 2.1 time: 0.213990 Jul 15 20:37:58.443448 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 70/141] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:58 2022] GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:37:59.459137 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-e89bdf9a-501b-49cb-a21f-63b041ddb5de tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:37:59.460336 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-e89bdf9a-501b-49cb-a21f-63b041ddb5de tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:37:59.467093 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e89bdf9a-501b-49cb-a21f-63b041ddb5de tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:59.468752 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e89bdf9a-501b-49cb-a21f-63b041ddb5de tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:59.470231 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e89bdf9a-501b-49cb-a21f-63b041ddb5de tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:37:59.470759 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e89bdf9a-501b-49cb-a21f-63b041ddb5de tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:37:59.641979 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-e89bdf9a-501b-49cb-a21f-63b041ddb5de tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:37:59.651358 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-e89bdf9a-501b-49cb-a21f-63b041ddb5de tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc" status: 200 len: 1522 microversion: 2.1 time: 0.196079 Jul 15 20:37:59.652047 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 72/142] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:37:59 2022] GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:00.670125 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-62a4bece-3b80-42cd-be86-d6c167436e69 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:00.671725 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-62a4bece-3b80-42cd-be86-d6c167436e69 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:00.696570 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-62a4bece-3b80-42cd-be86-d6c167436e69 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:00.697935 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-62a4bece-3b80-42cd-be86-d6c167436e69 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:00.702642 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-62a4bece-3b80-42cd-be86-d6c167436e69 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:00.703462 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-62a4bece-3b80-42cd-be86-d6c167436e69 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:00.991906 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-62a4bece-3b80-42cd-be86-d6c167436e69 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:01.009113 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-62a4bece-3b80-42cd-be86-d6c167436e69 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc" status: 200 len: 1522 microversion: 2.1 time: 0.342636 Jul 15 20:38:01.011978 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 71/143] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:00 2022] GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc => generated 1522 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:02.028929 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-91b3e908-ed52-48ee-b7c9-802fa300846c tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:02.029484 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-91b3e908-ed52-48ee-b7c9-802fa300846c tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:02.036880 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-91b3e908-ed52-48ee-b7c9-802fa300846c tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:02.037319 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-91b3e908-ed52-48ee-b7c9-802fa300846c tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:02.038095 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-91b3e908-ed52-48ee-b7c9-802fa300846c tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:02.038517 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-91b3e908-ed52-48ee-b7c9-802fa300846c tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:02.202606 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-91b3e908-ed52-48ee-b7c9-802fa300846c tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:02.214107 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-91b3e908-ed52-48ee-b7c9-802fa300846c tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc" status: 200 len: 1522 microversion: 2.1 time: 0.189088 Jul 15 20:38:02.214692 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 73/144] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:02 2022] GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:02.600917 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-b20fb157-b38b-4b4a-80ce-022e8295e6b4 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:02.601464 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-b20fb157-b38b-4b4a-80ce-022e8295e6b4 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] [instance: 31e74255-0b4d-4c43-91ce-ffccffdc2188] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:02.613531 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b20fb157-b38b-4b4a-80ce-022e8295e6b4 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:02.614013 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b20fb157-b38b-4b4a-80ce-022e8295e6b4 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:02.619391 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b20fb157-b38b-4b4a-80ce-022e8295e6b4 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:02.623530 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b20fb157-b38b-4b4a-80ce-022e8295e6b4 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:02.679977 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-3d44a82e-4688-48ae-86e0-da63c1581210 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1315883019", "imageRef": "a759604a-67e3-4c79-b848-5d03d936d7a0", "flavorRef": "452", "networks": [{"uuid": "3de5205b-9819-41c2-a77d-3a58579765e3"}]}} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:38:02.719420 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-b20fb157-b38b-4b4a-80ce-022e8295e6b4 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] [instance: 31e74255-0b4d-4c43-91ce-ffccffdc2188] Going to try to terminate instance {{(pid=124430) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 20:38:02.768331 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.network.neutron [None req-3d44a82e-4688-48ae-86e0-da63c1581210 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] validate_networks() for [('3de5205b-9819-41c2-a77d-3a58579765e3', None, None, None, None, None)] {{(pid=124432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 20:38:02.889008 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-b20fb157-b38b-4b4a-80ce-022e8295e6b4 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] 10.222.0.66 "DELETE /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188" status: 204 len: 0 microversion: 2.1 time: 0.293908 Jul 15 20:38:02.889637 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 72/145] 10.222.0.66 () {58 vars in 1238 bytes} [Fri Jul 15 20:38:02 2022] DELETE /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 20:38:02.904878 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-4537d3aa-ed5e-4cf5-a6a1-815b28d41658 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:02.905621 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-4537d3aa-ed5e-4cf5-a6a1-815b28d41658 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] [instance: 31e74255-0b4d-4c43-91ce-ffccffdc2188] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:02.912740 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-4537d3aa-ed5e-4cf5-a6a1-815b28d41658 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:02.913197 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-4537d3aa-ed5e-4cf5-a6a1-815b28d41658 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:02.914164 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-4537d3aa-ed5e-4cf5-a6a1-815b28d41658 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:02.914981 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-4537d3aa-ed5e-4cf5-a6a1-815b28d41658 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:03.162022 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-4537d3aa-ed5e-4cf5-a6a1-815b28d41658 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f231f706d2f4d3e9070105bb5981cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f12afd420d4f6bad8e80207ea64d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:03.170751 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-4537d3aa-ed5e-4cf5-a6a1-815b28d41658 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] 10.222.0.66 "GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188" status: 200 len: 1554 microversion: 2.1 time: 0.274106 Jul 15 20:38:03.171637 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 73/146] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:02 2022] GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188 => generated 1554 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:03.231428 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-3c8335ce-4189-4ff6-ac91-525df9b92d5a tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:03.232323 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-3c8335ce-4189-4ff6-ac91-525df9b92d5a tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:03.238777 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-3c8335ce-4189-4ff6-ac91-525df9b92d5a tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:03.239364 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-3c8335ce-4189-4ff6-ac91-525df9b92d5a tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:03.240142 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-3c8335ce-4189-4ff6-ac91-525df9b92d5a tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:03.240628 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-3c8335ce-4189-4ff6-ac91-525df9b92d5a tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:03.268669 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:03.337820 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-3d44a82e-4688-48ae-86e0-da63c1581210 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Flavor limits 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 20:38:03.337820 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-3d44a82e-4688-48ae-86e0-da63c1581210 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Image limits 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 20:38:03.338373 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-3d44a82e-4688-48ae-86e0-da63c1581210 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Flavor pref 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 20:38:03.338373 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-3d44a82e-4688-48ae-86e0-da63c1581210 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Image pref 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 20:38:03.338727 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-3d44a82e-4688-48ae-86e0-da63c1581210 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 20:38:03.353113 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3d44a82e-4688-48ae-86e0-da63c1581210 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:03.353594 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3d44a82e-4688-48ae-86e0-da63c1581210 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:03.354396 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3d44a82e-4688-48ae-86e0-da63c1581210 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:03.355037 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3d44a82e-4688-48ae-86e0-da63c1581210 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:03.374151 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-3d44a82e-4688-48ae-86e0-da63c1581210 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Getting quotas for project 3129a35d484445db9e141028b2e77497. Resources: {'instances', 'ram', 'cores'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 20:38:03.378850 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-3d44a82e-4688-48ae-86e0-da63c1581210 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Getting quotas for user 932ad1f03da24593a6ad444f6cb95e6d and project 3129a35d484445db9e141028b2e77497. Resources: {'instances', 'ram', 'cores'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 20:38:03.390306 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-3d44a82e-4688-48ae-86e0-da63c1581210 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Going to run 1 instances... {{(pid=124432) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 20:38:03.393001 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-3d44a82e-4688-48ae-86e0-da63c1581210 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] [instance: 3839ab3a-cad8-488a-bbed-4f7c792b804e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a759604a-67e3-4c79-b848-5d03d936d7a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 20:38:03.408359 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-3c8335ce-4189-4ff6-ac91-525df9b92d5a tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:03.417375 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-3c8335ce-4189-4ff6-ac91-525df9b92d5a tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc" status: 200 len: 1522 microversion: 2.1 time: 0.189342 Jul 15 20:38:03.418228 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 74/147] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:03 2022] GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:38:03.442468 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-3d44a82e-4688-48ae-86e0-da63c1581210 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.766426 Jul 15 20:38:03.443278 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 74/148] 10.222.0.66 () {60 vars in 1146 bytes} [Fri Jul 15 20:38:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 768 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 15 20:38:03.453125 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-df528bd3-152e-4119-bd53-ec3b26ff2920 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:03.455126 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-df528bd3-152e-4119-bd53-ec3b26ff2920 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] [instance: 3839ab3a-cad8-488a-bbed-4f7c792b804e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:03.521477 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-df528bd3-152e-4119-bd53-ec3b26ff2920 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932ad1f03da24593a6ad444f6cb95e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129a35d484445db9e141028b2e77497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:03.528756 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-df528bd3-152e-4119-bd53-ec3b26ff2920 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] 10.222.0.66 "GET /compute/v2.1/servers/3839ab3a-cad8-488a-bbed-4f7c792b804e" status: 200 len: 1214 microversion: 2.1 time: 0.079497 Jul 15 20:38:03.529328 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 75/149] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:03 2022] GET /compute/v2.1/servers/3839ab3a-cad8-488a-bbed-4f7c792b804e => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:04.188682 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-7cbe9a27-1971-42ec-9bbf-3a01308b199c tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:04.189479 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-7cbe9a27-1971-42ec-9bbf-3a01308b199c tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] [instance: 31e74255-0b4d-4c43-91ce-ffccffdc2188] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:04.195593 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7cbe9a27-1971-42ec-9bbf-3a01308b199c tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:04.196044 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7cbe9a27-1971-42ec-9bbf-3a01308b199c tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:04.196865 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7cbe9a27-1971-42ec-9bbf-3a01308b199c tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:04.197301 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7cbe9a27-1971-42ec-9bbf-3a01308b199c tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:04.334496 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-7cbe9a27-1971-42ec-9bbf-3a01308b199c tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f231f706d2f4d3e9070105bb5981cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f12afd420d4f6bad8e80207ea64d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:04.338020 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:04.343423 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-7cbe9a27-1971-42ec-9bbf-3a01308b199c tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] 10.222.0.66 "GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188" status: 200 len: 1554 microversion: 2.1 time: 0.159184 Jul 15 20:38:04.343940 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 75/150] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:04 2022] GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188 => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:04.436047 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-a9a42c77-4a5a-4227-9fee-3de892d70607 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:04.436679 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-a9a42c77-4a5a-4227-9fee-3de892d70607 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:04.443947 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-a9a42c77-4a5a-4227-9fee-3de892d70607 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:04.444316 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-a9a42c77-4a5a-4227-9fee-3de892d70607 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:04.445119 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-a9a42c77-4a5a-4227-9fee-3de892d70607 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:04.445559 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-a9a42c77-4a5a-4227-9fee-3de892d70607 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:04.546360 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-1c69df25-f140-4b67-b254-8f56fe8e1303 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:04.547068 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-1c69df25-f140-4b67-b254-8f56fe8e1303 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] [instance: 3839ab3a-cad8-488a-bbed-4f7c792b804e] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:04.555430 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1c69df25-f140-4b67-b254-8f56fe8e1303 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:04.555958 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1c69df25-f140-4b67-b254-8f56fe8e1303 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:04.556842 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1c69df25-f140-4b67-b254-8f56fe8e1303 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:04.557347 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1c69df25-f140-4b67-b254-8f56fe8e1303 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:04.585517 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-a9a42c77-4a5a-4227-9fee-3de892d70607 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:04.592936 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-a9a42c77-4a5a-4227-9fee-3de892d70607 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc" status: 200 len: 1522 microversion: 2.1 time: 0.160747 Jul 15 20:38:04.593565 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 76/151] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:04 2022] GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:04.620359 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-1c69df25-f140-4b67-b254-8f56fe8e1303 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932ad1f03da24593a6ad444f6cb95e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129a35d484445db9e141028b2e77497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:04.628405 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-1c69df25-f140-4b67-b254-8f56fe8e1303 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] 10.222.0.66 "GET /compute/v2.1/servers/3839ab3a-cad8-488a-bbed-4f7c792b804e" status: 200 len: 1218 microversion: 2.1 time: 0.086065 Jul 15 20:38:04.629015 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 76/152] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:04 2022] GET /compute/v2.1/servers/3839ab3a-cad8-488a-bbed-4f7c792b804e => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:38:05.362552 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-88bd4847-5b5a-4f10-bec4-4f2e540f38b9 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:05.363169 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-88bd4847-5b5a-4f10-bec4-4f2e540f38b9 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] [instance: 31e74255-0b4d-4c43-91ce-ffccffdc2188] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:05.370053 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-88bd4847-5b5a-4f10-bec4-4f2e540f38b9 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:05.370499 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-88bd4847-5b5a-4f10-bec4-4f2e540f38b9 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:05.371262 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-88bd4847-5b5a-4f10-bec4-4f2e540f38b9 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:05.371695 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-88bd4847-5b5a-4f10-bec4-4f2e540f38b9 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:05.502889 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-88bd4847-5b5a-4f10-bec4-4f2e540f38b9 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f231f706d2f4d3e9070105bb5981cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f12afd420d4f6bad8e80207ea64d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:05.511310 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-88bd4847-5b5a-4f10-bec4-4f2e540f38b9 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] 10.222.0.66 "GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188" status: 200 len: 1554 microversion: 2.1 time: 0.153735 Jul 15 20:38:05.511875 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 77/153] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:05 2022] GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188 => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:38:05.610921 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-b48fea96-f3e5-4bc4-aa88-a14f844d5ce3 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:05.611549 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-b48fea96-f3e5-4bc4-aa88-a14f844d5ce3 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:05.618262 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b48fea96-f3e5-4bc4-aa88-a14f844d5ce3 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:05.618718 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b48fea96-f3e5-4bc4-aa88-a14f844d5ce3 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:05.619487 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b48fea96-f3e5-4bc4-aa88-a14f844d5ce3 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:05.619935 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b48fea96-f3e5-4bc4-aa88-a14f844d5ce3 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:05.645849 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-16f3f60d-097c-4f34-8579-8d934ef75231 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:05.646509 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-16f3f60d-097c-4f34-8579-8d934ef75231 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] [instance: 3839ab3a-cad8-488a-bbed-4f7c792b804e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:05.652846 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-16f3f60d-097c-4f34-8579-8d934ef75231 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:05.653291 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-16f3f60d-097c-4f34-8579-8d934ef75231 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:05.654057 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-16f3f60d-097c-4f34-8579-8d934ef75231 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:05.654486 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-16f3f60d-097c-4f34-8579-8d934ef75231 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:05.726907 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-16f3f60d-097c-4f34-8579-8d934ef75231 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932ad1f03da24593a6ad444f6cb95e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129a35d484445db9e141028b2e77497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:05.736666 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-16f3f60d-097c-4f34-8579-8d934ef75231 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] 10.222.0.66 "GET /compute/v2.1/servers/3839ab3a-cad8-488a-bbed-4f7c792b804e" status: 200 len: 1210 microversion: 2.1 time: 0.093476 Jul 15 20:38:05.737281 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 78/154] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:05 2022] GET /compute/v2.1/servers/3839ab3a-cad8-488a-bbed-4f7c792b804e => generated 1210 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:05.798258 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-b48fea96-f3e5-4bc4-aa88-a14f844d5ce3 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:05.806922 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-b48fea96-f3e5-4bc4-aa88-a14f844d5ce3 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc" status: 200 len: 1522 microversion: 2.1 time: 0.200426 Jul 15 20:38:05.807551 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 77/155] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:05 2022] GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:06.530069 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-813a1bb5-cde5-443c-8e3d-36b9ee7a04c6 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:06.531091 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-813a1bb5-cde5-443c-8e3d-36b9ee7a04c6 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] [instance: 31e74255-0b4d-4c43-91ce-ffccffdc2188] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:06.539239 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-813a1bb5-cde5-443c-8e3d-36b9ee7a04c6 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:06.539905 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-813a1bb5-cde5-443c-8e3d-36b9ee7a04c6 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:06.540907 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-813a1bb5-cde5-443c-8e3d-36b9ee7a04c6 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:06.541348 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-813a1bb5-cde5-443c-8e3d-36b9ee7a04c6 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:06.755026 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-4e255175-006c-4dfc-8612-34189c5b00cc tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:06.755494 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-4e255175-006c-4dfc-8612-34189c5b00cc tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] [instance: 3839ab3a-cad8-488a-bbed-4f7c792b804e] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:06.761899 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4e255175-006c-4dfc-8612-34189c5b00cc tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:06.762604 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4e255175-006c-4dfc-8612-34189c5b00cc tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:06.763391 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4e255175-006c-4dfc-8612-34189c5b00cc tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:06.763828 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4e255175-006c-4dfc-8612-34189c5b00cc tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:06.960482 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-4e255175-006c-4dfc-8612-34189c5b00cc tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932ad1f03da24593a6ad444f6cb95e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129a35d484445db9e141028b2e77497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:06.969946 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-4e255175-006c-4dfc-8612-34189c5b00cc tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] 10.222.0.66 "GET /compute/v2.1/servers/3839ab3a-cad8-488a-bbed-4f7c792b804e" status: 200 len: 1210 microversion: 2.1 time: 0.218772 Jul 15 20:38:06.971627 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 78/156] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:06 2022] GET /compute/v2.1/servers/3839ab3a-cad8-488a-bbed-4f7c792b804e => generated 1210 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:38:06.976565 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-f0725e8d-de4a-4696-a6dc-7a8ad60c7726 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:06.977289 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-f0725e8d-de4a-4696-a6dc-7a8ad60c7726 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:06.982082 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-813a1bb5-cde5-443c-8e3d-36b9ee7a04c6 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f231f706d2f4d3e9070105bb5981cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f12afd420d4f6bad8e80207ea64d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:06.984003 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f0725e8d-de4a-4696-a6dc-7a8ad60c7726 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:06.984771 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f0725e8d-de4a-4696-a6dc-7a8ad60c7726 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:06.986838 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f0725e8d-de4a-4696-a6dc-7a8ad60c7726 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:06.987535 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f0725e8d-de4a-4696-a6dc-7a8ad60c7726 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:06.994628 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-813a1bb5-cde5-443c-8e3d-36b9ee7a04c6 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] 10.222.0.66 "GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188" status: 200 len: 1554 microversion: 2.1 time: 0.470464 Jul 15 20:38:06.995475 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 79/157] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:06 2022] GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188 => generated 1554 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:07.211768 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-f0725e8d-de4a-4696-a6dc-7a8ad60c7726 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:07.225538 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-f0725e8d-de4a-4696-a6dc-7a8ad60c7726 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc" status: 200 len: 1522 microversion: 2.1 time: 0.251885 Jul 15 20:38:07.226195 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 79/158] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:06 2022] GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc => generated 1522 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:07.989065 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-8aeaf252-1ebd-4822-8396-99bc1222df40 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:07.990684 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-8aeaf252-1ebd-4822-8396-99bc1222df40 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] [instance: 3839ab3a-cad8-488a-bbed-4f7c792b804e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:07.999823 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8aeaf252-1ebd-4822-8396-99bc1222df40 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:08.001420 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8aeaf252-1ebd-4822-8396-99bc1222df40 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:08.002328 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8aeaf252-1ebd-4822-8396-99bc1222df40 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:08.002868 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8aeaf252-1ebd-4822-8396-99bc1222df40 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:08.013344 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-4e78c4d8-f1d3-4eb7-b579-c571dd1394ad tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:08.014023 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-4e78c4d8-f1d3-4eb7-b579-c571dd1394ad tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] [instance: 31e74255-0b4d-4c43-91ce-ffccffdc2188] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:08.022895 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4e78c4d8-f1d3-4eb7-b579-c571dd1394ad tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:08.023407 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4e78c4d8-f1d3-4eb7-b579-c571dd1394ad tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:08.024240 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4e78c4d8-f1d3-4eb7-b579-c571dd1394ad tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:08.024699 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4e78c4d8-f1d3-4eb7-b579-c571dd1394ad tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:08.104654 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-8aeaf252-1ebd-4822-8396-99bc1222df40 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932ad1f03da24593a6ad444f6cb95e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129a35d484445db9e141028b2e77497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:08.117385 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-8aeaf252-1ebd-4822-8396-99bc1222df40 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] 10.222.0.66 "GET /compute/v2.1/servers/3839ab3a-cad8-488a-bbed-4f7c792b804e" status: 200 len: 1210 microversion: 2.1 time: 0.133011 Jul 15 20:38:08.118227 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 80/159] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:07 2022] GET /compute/v2.1/servers/3839ab3a-cad8-488a-bbed-4f7c792b804e => generated 1210 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:08.224257 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-4e78c4d8-f1d3-4eb7-b579-c571dd1394ad tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f231f706d2f4d3e9070105bb5981cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f12afd420d4f6bad8e80207ea64d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:08.234247 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-4e78c4d8-f1d3-4eb7-b579-c571dd1394ad tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] 10.222.0.66 "GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188" status: 200 len: 1554 microversion: 2.1 time: 0.225849 Jul 15 20:38:08.234982 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 80/160] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:08 2022] GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188 => generated 1554 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:08.249367 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-cba21293-ab76-4084-b0e3-e430eab9b414 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:08.250255 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-cba21293-ab76-4084-b0e3-e430eab9b414 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:08.257313 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-cba21293-ab76-4084-b0e3-e430eab9b414 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:08.257765 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-cba21293-ab76-4084-b0e3-e430eab9b414 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:08.258737 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-cba21293-ab76-4084-b0e3-e430eab9b414 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:08.259280 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-cba21293-ab76-4084-b0e3-e430eab9b414 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:08.421099 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-cba21293-ab76-4084-b0e3-e430eab9b414 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:08.434700 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-cba21293-ab76-4084-b0e3-e430eab9b414 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc" status: 200 len: 1522 microversion: 2.1 time: 0.189445 Jul 15 20:38:08.435283 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 81/161] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:08 2022] GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:09.135085 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-18aab778-b2a3-428f-8583-3463b3d750d3 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:09.135783 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-18aab778-b2a3-428f-8583-3463b3d750d3 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] [instance: 3839ab3a-cad8-488a-bbed-4f7c792b804e] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:09.144692 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-18aab778-b2a3-428f-8583-3463b3d750d3 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:09.145270 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-18aab778-b2a3-428f-8583-3463b3d750d3 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:09.146292 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-18aab778-b2a3-428f-8583-3463b3d750d3 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:09.147371 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-18aab778-b2a3-428f-8583-3463b3d750d3 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:09.218059 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-18aab778-b2a3-428f-8583-3463b3d750d3 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932ad1f03da24593a6ad444f6cb95e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129a35d484445db9e141028b2e77497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:09.226572 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-18aab778-b2a3-428f-8583-3463b3d750d3 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] 10.222.0.66 "GET /compute/v2.1/servers/3839ab3a-cad8-488a-bbed-4f7c792b804e" status: 200 len: 1210 microversion: 2.1 time: 0.095408 Jul 15 20:38:09.227190 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 81/162] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:09 2022] GET /compute/v2.1/servers/3839ab3a-cad8-488a-bbed-4f7c792b804e => generated 1210 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:09.253391 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-7b22495f-b326-4fb7-9f0e-6eccd4f33aa2 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:09.254761 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-7b22495f-b326-4fb7-9f0e-6eccd4f33aa2 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] [instance: 31e74255-0b4d-4c43-91ce-ffccffdc2188] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:09.262573 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-7b22495f-b326-4fb7-9f0e-6eccd4f33aa2 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:09.263100 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-7b22495f-b326-4fb7-9f0e-6eccd4f33aa2 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:09.264073 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-7b22495f-b326-4fb7-9f0e-6eccd4f33aa2 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:09.264633 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-7b22495f-b326-4fb7-9f0e-6eccd4f33aa2 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:09.458887 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-9577a429-1959-4c7e-bc16-1ffb7cbe8b8b tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:09.461839 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-9577a429-1959-4c7e-bc16-1ffb7cbe8b8b tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:09.492831 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9577a429-1959-4c7e-bc16-1ffb7cbe8b8b tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:09.497059 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-7b22495f-b326-4fb7-9f0e-6eccd4f33aa2 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f231f706d2f4d3e9070105bb5981cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f12afd420d4f6bad8e80207ea64d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:09.502180 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9577a429-1959-4c7e-bc16-1ffb7cbe8b8b tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:09.503697 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9577a429-1959-4c7e-bc16-1ffb7cbe8b8b tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:09.504450 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9577a429-1959-4c7e-bc16-1ffb7cbe8b8b tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:09.518195 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-7b22495f-b326-4fb7-9f0e-6eccd4f33aa2 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] 10.222.0.66 "GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188" status: 200 len: 1554 microversion: 2.1 time: 0.268789 Jul 15 20:38:09.519158 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 82/163] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:09 2022] GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188 => generated 1554 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:09.657755 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-9577a429-1959-4c7e-bc16-1ffb7cbe8b8b tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:09.666078 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-9577a429-1959-4c7e-bc16-1ffb7cbe8b8b tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc" status: 200 len: 1522 microversion: 2.1 time: 0.217119 Jul 15 20:38:09.666743 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 82/164] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:09 2022] GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:10.244022 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-056f8bb0-6c52-4f81-adc9-e32982544117 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:10.244655 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-056f8bb0-6c52-4f81-adc9-e32982544117 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] [instance: 3839ab3a-cad8-488a-bbed-4f7c792b804e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:10.254009 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-056f8bb0-6c52-4f81-adc9-e32982544117 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:10.255557 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-056f8bb0-6c52-4f81-adc9-e32982544117 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:10.256536 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-056f8bb0-6c52-4f81-adc9-e32982544117 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:10.257195 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-056f8bb0-6c52-4f81-adc9-e32982544117 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:10.326029 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-056f8bb0-6c52-4f81-adc9-e32982544117 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932ad1f03da24593a6ad444f6cb95e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129a35d484445db9e141028b2e77497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:10.333984 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-056f8bb0-6c52-4f81-adc9-e32982544117 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] 10.222.0.66 "GET /compute/v2.1/servers/3839ab3a-cad8-488a-bbed-4f7c792b804e" status: 200 len: 1272 microversion: 2.1 time: 0.094772 Jul 15 20:38:10.334854 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 83/165] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:10 2022] GET /compute/v2.1/servers/3839ab3a-cad8-488a-bbed-4f7c792b804e => generated 1272 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:10.535721 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-052cfe2d-8103-4d38-ab1e-2f05b2777b83 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:10.537011 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-052cfe2d-8103-4d38-ab1e-2f05b2777b83 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] [instance: 31e74255-0b4d-4c43-91ce-ffccffdc2188] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:10.547447 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-052cfe2d-8103-4d38-ab1e-2f05b2777b83 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:10.548101 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-052cfe2d-8103-4d38-ab1e-2f05b2777b83 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:10.549069 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-052cfe2d-8103-4d38-ab1e-2f05b2777b83 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:10.550300 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-052cfe2d-8103-4d38-ab1e-2f05b2777b83 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:10.683309 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-8b0eba87-e933-4884-a710-da9574b9ce72 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:10.684622 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-8b0eba87-e933-4884-a710-da9574b9ce72 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:10.700785 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8b0eba87-e933-4884-a710-da9574b9ce72 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:10.701301 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8b0eba87-e933-4884-a710-da9574b9ce72 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:10.702115 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8b0eba87-e933-4884-a710-da9574b9ce72 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:10.706733 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8b0eba87-e933-4884-a710-da9574b9ce72 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:10.769535 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-052cfe2d-8103-4d38-ab1e-2f05b2777b83 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f231f706d2f4d3e9070105bb5981cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f12afd420d4f6bad8e80207ea64d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:10.778962 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-052cfe2d-8103-4d38-ab1e-2f05b2777b83 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] 10.222.0.66 "GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188" status: 200 len: 1554 microversion: 2.1 time: 0.247840 Jul 15 20:38:10.784778 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 83/166] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:10 2022] GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188 => generated 1554 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:10.978899 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-8b0eba87-e933-4884-a710-da9574b9ce72 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:10.993244 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-8b0eba87-e933-4884-a710-da9574b9ce72 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc" status: 200 len: 1522 microversion: 2.1 time: 0.313646 Jul 15 20:38:10.993977 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 84/167] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:10 2022] GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc => generated 1522 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:11.351340 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-3e00e879-a8cd-4633-8169-b363023cf2a5 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:11.351944 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-3e00e879-a8cd-4633-8169-b363023cf2a5 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] [instance: 3839ab3a-cad8-488a-bbed-4f7c792b804e] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:11.364783 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3e00e879-a8cd-4633-8169-b363023cf2a5 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:11.365316 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3e00e879-a8cd-4633-8169-b363023cf2a5 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:11.366135 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3e00e879-a8cd-4633-8169-b363023cf2a5 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:11.367337 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3e00e879-a8cd-4633-8169-b363023cf2a5 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:11.487403 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-3e00e879-a8cd-4633-8169-b363023cf2a5 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932ad1f03da24593a6ad444f6cb95e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129a35d484445db9e141028b2e77497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:11.495316 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-3e00e879-a8cd-4633-8169-b363023cf2a5 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] 10.222.0.66 "GET /compute/v2.1/servers/3839ab3a-cad8-488a-bbed-4f7c792b804e" status: 200 len: 1272 microversion: 2.1 time: 0.147726 Jul 15 20:38:11.496212 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 84/168] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:11 2022] GET /compute/v2.1/servers/3839ab3a-cad8-488a-bbed-4f7c792b804e => generated 1272 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:11.550227 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [req-f1a8760f-1ee0-4bc1-a11c-275c6950df42 req-22108248-fef6-406e-b57e-15c32e485892 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31e74255-0b4d-4c43-91ce-ffccffdc2188", "name": "network-vif-deleted", "tag": "e782e7a7-19dc-48bb-8058-13652a1a4b65"}]} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:38:11.595714 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-f1a8760f-1ee0-4bc1-a11c-275c6950df42 req-22108248-fef6-406e-b57e-15c32e485892 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:11.597052 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-f1a8760f-1ee0-4bc1-a11c-275c6950df42 req-22108248-fef6-406e-b57e-15c32e485892 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:11.619587 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.compute.server_external_events [req-f1a8760f-1ee0-4bc1-a11c-275c6950df42 req-22108248-fef6-406e-b57e-15c32e485892 service nova] Creating event network-vif-deleted:e782e7a7-19dc-48bb-8058-13652a1a4b65 for instance 31e74255-0b4d-4c43-91ce-ffccffdc2188 on hv-cinder-79987 Jul 15 20:38:11.627496 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [req-f1a8760f-1ee0-4bc1-a11c-275c6950df42 req-22108248-fef6-406e-b57e-15c32e485892 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082659 Jul 15 20:38:11.628294 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 85/169] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:38:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:38:11.803312 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-7f8323d3-7cd0-4a6d-aec1-b7c72bfe0290 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:11.803915 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-7f8323d3-7cd0-4a6d-aec1-b7c72bfe0290 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] [instance: 31e74255-0b4d-4c43-91ce-ffccffdc2188] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:11.811111 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7f8323d3-7cd0-4a6d-aec1-b7c72bfe0290 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:11.811552 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7f8323d3-7cd0-4a6d-aec1-b7c72bfe0290 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:11.812310 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7f8323d3-7cd0-4a6d-aec1-b7c72bfe0290 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:11.813157 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7f8323d3-7cd0-4a6d-aec1-b7c72bfe0290 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:11.887950 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-7f8323d3-7cd0-4a6d-aec1-b7c72bfe0290 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f231f706d2f4d3e9070105bb5981cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f12afd420d4f6bad8e80207ea64d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:11.898776 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-7f8323d3-7cd0-4a6d-aec1-b7c72bfe0290 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] 10.222.0.66 "GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188" status: 200 len: 1346 microversion: 2.1 time: 0.100200 Jul 15 20:38:11.899732 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 85/170] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:11 2022] GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188 => generated 1346 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:12.013817 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-a91b6e13-18ed-4169-874e-8fb505e3e068 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:12.014512 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-a91b6e13-18ed-4169-874e-8fb505e3e068 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:12.030005 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-a91b6e13-18ed-4169-874e-8fb505e3e068 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:12.030505 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-a91b6e13-18ed-4169-874e-8fb505e3e068 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:12.034743 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-a91b6e13-18ed-4169-874e-8fb505e3e068 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:12.035221 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-a91b6e13-18ed-4169-874e-8fb505e3e068 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:12.243680 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-a91b6e13-18ed-4169-874e-8fb505e3e068 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:12.254678 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-a91b6e13-18ed-4169-874e-8fb505e3e068 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc" status: 200 len: 1522 microversion: 2.1 time: 0.245974 Jul 15 20:38:12.255492 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 86/171] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:12 2022] GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:12.512228 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-097488a0-6bf3-429b-9345-f7da5e7cbdad tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:12.512859 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-097488a0-6bf3-429b-9345-f7da5e7cbdad tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] [instance: 3839ab3a-cad8-488a-bbed-4f7c792b804e] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:12.525607 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-097488a0-6bf3-429b-9345-f7da5e7cbdad tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:12.526338 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-097488a0-6bf3-429b-9345-f7da5e7cbdad tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:12.527283 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-097488a0-6bf3-429b-9345-f7da5e7cbdad tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:12.527861 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-097488a0-6bf3-429b-9345-f7da5e7cbdad tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:12.880409 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-097488a0-6bf3-429b-9345-f7da5e7cbdad tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932ad1f03da24593a6ad444f6cb95e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129a35d484445db9e141028b2e77497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:12.894581 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-097488a0-6bf3-429b-9345-f7da5e7cbdad tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] 10.222.0.66 "GET /compute/v2.1/servers/3839ab3a-cad8-488a-bbed-4f7c792b804e" status: 200 len: 1314 microversion: 2.1 time: 0.385957 Jul 15 20:38:12.895189 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 86/172] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:12 2022] GET /compute/v2.1/servers/3839ab3a-cad8-488a-bbed-4f7c792b804e => generated 1314 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:12.921507 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-9241d877-7d3e-4553-a085-b39098856098 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:12.922657 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-9241d877-7d3e-4553-a085-b39098856098 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] [instance: 31e74255-0b4d-4c43-91ce-ffccffdc2188] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:12.945746 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-9241d877-7d3e-4553-a085-b39098856098 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:12.948513 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-9241d877-7d3e-4553-a085-b39098856098 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:12.949396 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-9241d877-7d3e-4553-a085-b39098856098 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:12.950388 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-9241d877-7d3e-4553-a085-b39098856098 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:12.983249 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.wsgi [None req-9241d877-7d3e-4553-a085-b39098856098 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] HTTP exception thrown: Instance 31e74255-0b4d-4c43-91ce-ffccffdc2188 could not be found. Jul 15 20:38:12.993105 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-9241d877-7d3e-4553-a085-b39098856098 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Request method failure captured: Jul 15 20:38:12.993105 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: request: GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188 HTTP/1.1 Jul 15 20:38:12.993105 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Accept: application/json Jul 15 20:38:12.993105 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Accept-Encoding: identity Jul 15 20:38:12.993105 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Connection: close Jul 15 20:38:12.993105 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Content-Length: 0 Jul 15 20:38:12.993105 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Content-Type: application/json Jul 15 20:38:12.993105 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Host: 10.222.0.66 Jul 15 20:38:12.993105 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Openstack-System-Scope: None Jul 15 20:38:12.993105 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: User-Agent: python-urllib3/1.26.9 Jul 15 20:38:12.993105 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Auth-Token: gAAAAABi0c_jZT2dfZZlR2W4_fcR5MkzDWImtmTfW3ADh6HotdWWA8rsfjVFI7XJHAOJ7uhrBHmJjtzXoTUD8SfJkawscDleH4TP9jbdiOlYVKZRp5FfW7fSah0f-uBtnGRSJy41Eyca3DIoFXfMu3ResFViq5fYrgjBnc7tyjXcKGdSpQBc9wM Jul 15 20:38:12.993105 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Domain-Id: None Jul 15 20:38:12.993105 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Domain-Name: None Jul 15 20:38:12.993105 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Identity-Status: Confirmed Jul 15 20:38:12.993105 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Is-Admin-Project: True Jul 15 20:38:12.993105 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Domain-Id: default Jul 15 20:38:12.993105 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Domain-Name: Default Jul 15 20:38:12.993105 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Id: d2f12afd420d4f6bad8e80207ea64d44 Jul 15 20:38:12.993105 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Name: tempest-DeleteServersTestJSON-1313573122 Jul 15 20:38:12.993105 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Role: member,reader Jul 15 20:38:12.993105 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Roles: member,reader Jul 15 20:38:12.995056 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d2f12afd420d4f6bad8e80207ea64d44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_d2f12afd420d4f6bad8e80207ea64d44"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d2f12afd420d4f6bad8e80207ea64d44"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/d2f12afd420d4f6bad8e80207ea64d44"}]}] Jul 15 20:38:12.995056 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant: tempest-DeleteServersTestJSON-1313573122 Jul 15 20:38:12.995056 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant-Id: d2f12afd420d4f6bad8e80207ea64d44 Jul 15 20:38:12.995056 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant-Name: tempest-DeleteServersTestJSON-1313573122 Jul 15 20:38:12.995056 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User: tempest-DeleteServersTestJSON-1313573122-project Jul 15 20:38:12.995056 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Domain-Id: default Jul 15 20:38:12.995056 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Domain-Name: Default Jul 15 20:38:12.995056 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Id: 1f231f706d2f4d3e9070105bb5981cec Jul 15 20:38:12.995056 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Name: tempest-DeleteServersTestJSON-1313573122-project Jul 15 20:38:12.995056 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: method: > Jul 15 20:38:12.995056 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: exception: Instance 31e74255-0b4d-4c43-91ce-ffccffdc2188 could not be found. Jul 15 20:38:12.995056 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: action_args: {'id': '31e74255-0b4d-4c43-91ce-ffccffdc2188'} Jul 15 20:38:12.995987 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 20:38:12.995987 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:38:12.995987 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 20:38:12.995987 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 20:38:12.995987 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 20:38:12.995987 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 20:38:12.995987 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 20:38:12.995987 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 20:38:12.995987 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 20:38:12.995987 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 20:38:12.995987 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31e74255-0b4d-4c43-91ce-ffccffdc2188 could not be found. Jul 15 20:38:12.995987 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:38:12.995987 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:38:12.995987 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:38:12.995987 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:38:12.995987 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:38:12.995987 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:38:12.995987 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 20:38:12.995987 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 20:38:12.995987 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 20:38:12.997383 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 20:38:12.997383 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 20:38:12.997383 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 20:38:12.997383 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 20:38:12.997383 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 20:38:12.997383 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 20:38:12.997383 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 20:38:12.997383 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31e74255-0b4d-4c43-91ce-ffccffdc2188 could not be found. Jul 15 20:38:12.997383 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:38:12.997383 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:38:12.997383 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:38:12.997383 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:38:12.997383 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:38:12.997383 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:38:12.997383 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 20:38:12.997383 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 20:38:12.997383 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31e74255-0b4d-4c43-91ce-ffccffdc2188 could not be found. Jul 15 20:38:12.997383 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:38:13.001613 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-9241d877-7d3e-4553-a085-b39098856098 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Returning 404 to user: Instance 31e74255-0b4d-4c43-91ce-ffccffdc2188 could not be found. {{(pid=124430) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 20:38:13.002836 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-9241d877-7d3e-4553-a085-b39098856098 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] 10.222.0.66 "GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188" status: 404 len: 111 microversion: 2.1 time: 0.087806 Jul 15 20:38:13.003881 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 87/173] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:12 2022] GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 20:38:13.169021 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-49d3850a-90c0-4bdc-b878-72376f9086dd tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:13.169954 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-49d3850a-90c0-4bdc-b878-72376f9086dd tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] [instance: 31e74255-0b4d-4c43-91ce-ffccffdc2188] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:13.185220 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-49d3850a-90c0-4bdc-b878-72376f9086dd tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:13.185697 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-49d3850a-90c0-4bdc-b878-72376f9086dd tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:13.186776 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-49d3850a-90c0-4bdc-b878-72376f9086dd tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:13.187363 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-49d3850a-90c0-4bdc-b878-72376f9086dd tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:13.210936 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.wsgi [None req-49d3850a-90c0-4bdc-b878-72376f9086dd tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] HTTP exception thrown: Instance 31e74255-0b4d-4c43-91ce-ffccffdc2188 could not be found. Jul 15 20:38:13.216658 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-49d3850a-90c0-4bdc-b878-72376f9086dd tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Request method failure captured: Jul 15 20:38:13.216658 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: request: GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188/os-volume_attachments HTTP/1.1 Jul 15 20:38:13.216658 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Accept: application/json Jul 15 20:38:13.216658 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Accept-Encoding: identity Jul 15 20:38:13.216658 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Connection: close Jul 15 20:38:13.216658 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Content-Length: 0 Jul 15 20:38:13.216658 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Content-Type: application/json Jul 15 20:38:13.216658 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Host: 10.222.0.66 Jul 15 20:38:13.216658 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Openstack-System-Scope: None Jul 15 20:38:13.216658 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: User-Agent: python-urllib3/1.26.9 Jul 15 20:38:13.216658 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Auth-Token: gAAAAABi0c_jZT2dfZZlR2W4_fcR5MkzDWImtmTfW3ADh6HotdWWA8rsfjVFI7XJHAOJ7uhrBHmJjtzXoTUD8SfJkawscDleH4TP9jbdiOlYVKZRp5FfW7fSah0f-uBtnGRSJy41Eyca3DIoFXfMu3ResFViq5fYrgjBnc7tyjXcKGdSpQBc9wM Jul 15 20:38:13.216658 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Domain-Id: None Jul 15 20:38:13.216658 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Domain-Name: None Jul 15 20:38:13.216658 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Identity-Status: Confirmed Jul 15 20:38:13.216658 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Is-Admin-Project: True Jul 15 20:38:13.216658 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Domain-Id: default Jul 15 20:38:13.216658 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Domain-Name: Default Jul 15 20:38:13.216658 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Id: d2f12afd420d4f6bad8e80207ea64d44 Jul 15 20:38:13.216658 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Name: tempest-DeleteServersTestJSON-1313573122 Jul 15 20:38:13.216658 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Role: member,reader Jul 15 20:38:13.216658 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Roles: member,reader Jul 15 20:38:13.217986 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d2f12afd420d4f6bad8e80207ea64d44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_d2f12afd420d4f6bad8e80207ea64d44"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d2f12afd420d4f6bad8e80207ea64d44"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/d2f12afd420d4f6bad8e80207ea64d44"}]}] Jul 15 20:38:13.217986 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Tenant: tempest-DeleteServersTestJSON-1313573122 Jul 15 20:38:13.217986 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Tenant-Id: d2f12afd420d4f6bad8e80207ea64d44 Jul 15 20:38:13.217986 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Tenant-Name: tempest-DeleteServersTestJSON-1313573122 Jul 15 20:38:13.217986 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User: tempest-DeleteServersTestJSON-1313573122-project Jul 15 20:38:13.217986 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Domain-Id: default Jul 15 20:38:13.217986 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Domain-Name: Default Jul 15 20:38:13.217986 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Id: 1f231f706d2f4d3e9070105bb5981cec Jul 15 20:38:13.217986 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Name: tempest-DeleteServersTestJSON-1313573122-project Jul 15 20:38:13.217986 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: method: > Jul 15 20:38:13.217986 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: exception: Instance 31e74255-0b4d-4c43-91ce-ffccffdc2188 could not be found. Jul 15 20:38:13.217986 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: action_args: {'server_id': '31e74255-0b4d-4c43-91ce-ffccffdc2188'} Jul 15 20:38:13.218796 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 20:38:13.218796 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:38:13.218796 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 20:38:13.218796 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 20:38:13.218796 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 20:38:13.218796 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 20:38:13.218796 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 20:38:13.218796 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 20:38:13.218796 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 20:38:13.218796 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 20:38:13.218796 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31e74255-0b4d-4c43-91ce-ffccffdc2188 could not be found. Jul 15 20:38:13.218796 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:38:13.218796 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:38:13.218796 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:38:13.218796 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:38:13.218796 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:38:13.218796 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:38:13.218796 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 20:38:13.218796 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 20:38:13.218796 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 20:38:13.220325 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 20:38:13.220325 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 15 20:38:13.220325 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 15 20:38:13.220325 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 15 20:38:13.220325 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 15 20:38:13.220325 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 15 20:38:13.220325 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 15 20:38:13.220325 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 20:38:13.220325 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 20:38:13.220325 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31e74255-0b4d-4c43-91ce-ffccffdc2188 could not be found. Jul 15 20:38:13.220325 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:38:13.220325 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:38:13.220325 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:38:13.220325 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:38:13.220325 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:38:13.220325 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:38:13.220325 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 20:38:13.220325 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 20:38:13.220325 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31e74255-0b4d-4c43-91ce-ffccffdc2188 could not be found. Jul 15 20:38:13.220325 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:38:13.222370 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-49d3850a-90c0-4bdc-b878-72376f9086dd tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Returning 404 to user: Instance 31e74255-0b4d-4c43-91ce-ffccffdc2188 could not be found. {{(pid=124432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 20:38:13.223648 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-49d3850a-90c0-4bdc-b878-72376f9086dd tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] 10.222.0.66 "GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.063197 Jul 15 20:38:13.224369 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 87/174] 10.222.0.66 () {58 vars in 1301 bytes} [Fri Jul 15 20:38:13 2022] GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188/os-volume_attachments => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 20:38:13.274026 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-cb617c76-3f03-4933-a140-2800fa169fa8 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:13.274753 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-cb617c76-3f03-4933-a140-2800fa169fa8 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:13.292801 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-cb617c76-3f03-4933-a140-2800fa169fa8 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:13.292801 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-cb617c76-3f03-4933-a140-2800fa169fa8 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:13.292801 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-cb617c76-3f03-4933-a140-2800fa169fa8 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:13.292801 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-cb617c76-3f03-4933-a140-2800fa169fa8 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:13.529067 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_cell0:SELECT=2 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:13.532747 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-cb617c76-3f03-4933-a140-2800fa169fa8 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:13.544061 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-cb617c76-3f03-4933-a140-2800fa169fa8 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc" status: 200 len: 1522 microversion: 2.1 time: 0.275017 Jul 15 20:38:13.553685 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 88/175] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:13 2022] GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc => generated 1522 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:13.669493 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-0c5b0689-ee07-44c7-825f-d72ad8c24616 req-247b17ec-c817-43f1-9d1c-550235091063 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3839ab3a-cad8-488a-bbed-4f7c792b804e", "tag": "c40927c0-fac9-4c62-9a5f-0099d8d055d7"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:38:13.678762 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell0:SELECT=2 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:13.679776 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell0:SELECT=6 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:13.682923 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-0c5b0689-ee07-44c7-825f-d72ad8c24616 req-247b17ec-c817-43f1-9d1c-550235091063 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:13.683561 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-0c5b0689-ee07-44c7-825f-d72ad8c24616 req-247b17ec-c817-43f1-9d1c-550235091063 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:13.697458 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-0c5b0689-ee07-44c7-825f-d72ad8c24616 req-247b17ec-c817-43f1-9d1c-550235091063 service nova] Creating event network-changed:c40927c0-fac9-4c62-9a5f-0099d8d055d7 for instance 3839ab3a-cad8-488a-bbed-4f7c792b804e on hv-cinder-79987 Jul 15 20:38:13.702954 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-0c5b0689-ee07-44c7-825f-d72ad8c24616 req-247b17ec-c817-43f1-9d1c-550235091063 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039484 Jul 15 20:38:13.704803 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 88/176] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:38:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:38:13.918243 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-e4fc1dbc-397f-43f0-b493-ed2897388945 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:13.919019 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-e4fc1dbc-397f-43f0-b493-ed2897388945 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] [instance: 3839ab3a-cad8-488a-bbed-4f7c792b804e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:13.925977 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e4fc1dbc-397f-43f0-b493-ed2897388945 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:13.926557 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e4fc1dbc-397f-43f0-b493-ed2897388945 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:13.927366 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e4fc1dbc-397f-43f0-b493-ed2897388945 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:13.927890 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e4fc1dbc-397f-43f0-b493-ed2897388945 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:14.154004 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-e4fc1dbc-397f-43f0-b493-ed2897388945 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932ad1f03da24593a6ad444f6cb95e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129a35d484445db9e141028b2e77497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:14.163014 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-e4fc1dbc-397f-43f0-b493-ed2897388945 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] 10.222.0.66 "GET /compute/v2.1/servers/3839ab3a-cad8-488a-bbed-4f7c792b804e" status: 200 len: 1314 microversion: 2.1 time: 0.250833 Jul 15 20:38:14.163585 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 89/177] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:13 2022] GET /compute/v2.1/servers/3839ab3a-cad8-488a-bbed-4f7c792b804e => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:14.498590 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-8c0205df-bdcf-4a6c-8279-65e2940f44e0 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:14.499280 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-8c0205df-bdcf-4a6c-8279-65e2940f44e0 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] [instance: 31e74255-0b4d-4c43-91ce-ffccffdc2188] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:14.506162 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8c0205df-bdcf-4a6c-8279-65e2940f44e0 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:14.506781 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8c0205df-bdcf-4a6c-8279-65e2940f44e0 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:14.507549 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8c0205df-bdcf-4a6c-8279-65e2940f44e0 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:14.507970 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8c0205df-bdcf-4a6c-8279-65e2940f44e0 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:14.522814 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.wsgi [None req-8c0205df-bdcf-4a6c-8279-65e2940f44e0 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] HTTP exception thrown: Instance 31e74255-0b4d-4c43-91ce-ffccffdc2188 could not be found. Jul 15 20:38:14.525115 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-8c0205df-bdcf-4a6c-8279-65e2940f44e0 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Request method failure captured: Jul 15 20:38:14.525115 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: request: DELETE /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188 HTTP/1.1 Jul 15 20:38:14.525115 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Accept: application/json Jul 15 20:38:14.525115 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Accept-Encoding: identity Jul 15 20:38:14.525115 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Connection: close Jul 15 20:38:14.525115 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Content-Length: 0 Jul 15 20:38:14.525115 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Content-Type: application/json Jul 15 20:38:14.525115 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Host: 10.222.0.66 Jul 15 20:38:14.525115 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Openstack-System-Scope: None Jul 15 20:38:14.525115 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: User-Agent: python-urllib3/1.26.9 Jul 15 20:38:14.525115 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Auth-Token: gAAAAABi0c_jZT2dfZZlR2W4_fcR5MkzDWImtmTfW3ADh6HotdWWA8rsfjVFI7XJHAOJ7uhrBHmJjtzXoTUD8SfJkawscDleH4TP9jbdiOlYVKZRp5FfW7fSah0f-uBtnGRSJy41Eyca3DIoFXfMu3ResFViq5fYrgjBnc7tyjXcKGdSpQBc9wM Jul 15 20:38:14.525115 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Domain-Id: None Jul 15 20:38:14.525115 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Domain-Name: None Jul 15 20:38:14.525115 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Identity-Status: Confirmed Jul 15 20:38:14.525115 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Is-Admin-Project: True Jul 15 20:38:14.525115 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Domain-Id: default Jul 15 20:38:14.525115 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Domain-Name: Default Jul 15 20:38:14.525115 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Id: d2f12afd420d4f6bad8e80207ea64d44 Jul 15 20:38:14.525115 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Name: tempest-DeleteServersTestJSON-1313573122 Jul 15 20:38:14.525115 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Role: member,reader Jul 15 20:38:14.525115 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Roles: member,reader Jul 15 20:38:14.526266 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d2f12afd420d4f6bad8e80207ea64d44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_d2f12afd420d4f6bad8e80207ea64d44"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d2f12afd420d4f6bad8e80207ea64d44"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/d2f12afd420d4f6bad8e80207ea64d44"}]}] Jul 15 20:38:14.526266 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Tenant: tempest-DeleteServersTestJSON-1313573122 Jul 15 20:38:14.526266 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Tenant-Id: d2f12afd420d4f6bad8e80207ea64d44 Jul 15 20:38:14.526266 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Tenant-Name: tempest-DeleteServersTestJSON-1313573122 Jul 15 20:38:14.526266 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User: tempest-DeleteServersTestJSON-1313573122-project Jul 15 20:38:14.526266 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Domain-Id: default Jul 15 20:38:14.526266 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Domain-Name: Default Jul 15 20:38:14.526266 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Id: 1f231f706d2f4d3e9070105bb5981cec Jul 15 20:38:14.526266 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Name: tempest-DeleteServersTestJSON-1313573122-project Jul 15 20:38:14.526266 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: method: > Jul 15 20:38:14.526266 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: exception: Instance 31e74255-0b4d-4c43-91ce-ffccffdc2188 could not be found. Jul 15 20:38:14.526266 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: action_args: {'id': '31e74255-0b4d-4c43-91ce-ffccffdc2188'} Jul 15 20:38:14.530907 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 20:38:14.530907 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:38:14.530907 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 20:38:14.530907 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 20:38:14.530907 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 20:38:14.530907 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 20:38:14.530907 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 20:38:14.530907 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 20:38:14.530907 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 20:38:14.530907 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 20:38:14.530907 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31e74255-0b4d-4c43-91ce-ffccffdc2188 could not be found. Jul 15 20:38:14.530907 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:38:14.530907 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:38:14.530907 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:38:14.530907 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:38:14.530907 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:38:14.530907 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:38:14.530907 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 20:38:14.530907 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 20:38:14.530907 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 20:38:14.533393 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 20:38:14.533393 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 15 20:38:14.533393 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 15 20:38:14.533393 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 15 20:38:14.533393 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 15 20:38:14.533393 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 20:38:14.533393 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 20:38:14.533393 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 20:38:14.533393 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 20:38:14.533393 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31e74255-0b4d-4c43-91ce-ffccffdc2188 could not be found. Jul 15 20:38:14.533393 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:38:14.533393 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:38:14.533393 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:38:14.533393 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:38:14.533393 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:38:14.533393 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:38:14.533393 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 20:38:14.533393 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 20:38:14.533393 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31e74255-0b4d-4c43-91ce-ffccffdc2188 could not be found. Jul 15 20:38:14.533393 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:38:14.534985 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-8c0205df-bdcf-4a6c-8279-65e2940f44e0 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Returning 404 to user: Instance 31e74255-0b4d-4c43-91ce-ffccffdc2188 could not be found. {{(pid=124432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 20:38:14.534985 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-8c0205df-bdcf-4a6c-8279-65e2940f44e0 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] 10.222.0.66 "DELETE /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188" status: 404 len: 111 microversion: 2.1 time: 0.033059 Jul 15 20:38:14.534985 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 89/178] 10.222.0.66 () {58 vars in 1238 bytes} [Fri Jul 15 20:38:14 2022] DELETE /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 20:38:14.538118 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-59daef83-73be-4fd5-8650-024a2cd6fd96 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:14.539332 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-59daef83-73be-4fd5-8650-024a2cd6fd96 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] [instance: 31e74255-0b4d-4c43-91ce-ffccffdc2188] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:14.547086 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-59daef83-73be-4fd5-8650-024a2cd6fd96 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:14.547632 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-59daef83-73be-4fd5-8650-024a2cd6fd96 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:14.548521 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-59daef83-73be-4fd5-8650-024a2cd6fd96 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:14.549307 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-59daef83-73be-4fd5-8650-024a2cd6fd96 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:14.567085 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-61555057-13a1-4e1d-b138-b6094929a91a tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:14.567921 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-61555057-13a1-4e1d-b138-b6094929a91a tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:14.572665 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.wsgi [None req-59daef83-73be-4fd5-8650-024a2cd6fd96 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] HTTP exception thrown: Instance 31e74255-0b4d-4c43-91ce-ffccffdc2188 could not be found. Jul 15 20:38:14.574575 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-59daef83-73be-4fd5-8650-024a2cd6fd96 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Request method failure captured: Jul 15 20:38:14.574575 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: request: GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188 HTTP/1.1 Jul 15 20:38:14.574575 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Accept: application/json Jul 15 20:38:14.574575 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Accept-Encoding: identity Jul 15 20:38:14.574575 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Connection: close Jul 15 20:38:14.574575 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Content-Length: 0 Jul 15 20:38:14.574575 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Content-Type: application/json Jul 15 20:38:14.574575 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Host: 10.222.0.66 Jul 15 20:38:14.574575 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Openstack-System-Scope: None Jul 15 20:38:14.574575 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: User-Agent: python-urllib3/1.26.9 Jul 15 20:38:14.574575 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Auth-Token: gAAAAABi0c_jZT2dfZZlR2W4_fcR5MkzDWImtmTfW3ADh6HotdWWA8rsfjVFI7XJHAOJ7uhrBHmJjtzXoTUD8SfJkawscDleH4TP9jbdiOlYVKZRp5FfW7fSah0f-uBtnGRSJy41Eyca3DIoFXfMu3ResFViq5fYrgjBnc7tyjXcKGdSpQBc9wM Jul 15 20:38:14.574575 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Domain-Id: None Jul 15 20:38:14.574575 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Domain-Name: None Jul 15 20:38:14.574575 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Identity-Status: Confirmed Jul 15 20:38:14.574575 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Is-Admin-Project: True Jul 15 20:38:14.574575 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Domain-Id: default Jul 15 20:38:14.574575 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Domain-Name: Default Jul 15 20:38:14.574575 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Id: d2f12afd420d4f6bad8e80207ea64d44 Jul 15 20:38:14.574575 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Name: tempest-DeleteServersTestJSON-1313573122 Jul 15 20:38:14.574575 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Role: member,reader Jul 15 20:38:14.574575 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Roles: member,reader Jul 15 20:38:14.575737 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d2f12afd420d4f6bad8e80207ea64d44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_d2f12afd420d4f6bad8e80207ea64d44"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d2f12afd420d4f6bad8e80207ea64d44"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/d2f12afd420d4f6bad8e80207ea64d44"}]}] Jul 15 20:38:14.575737 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant: tempest-DeleteServersTestJSON-1313573122 Jul 15 20:38:14.575737 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant-Id: d2f12afd420d4f6bad8e80207ea64d44 Jul 15 20:38:14.575737 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant-Name: tempest-DeleteServersTestJSON-1313573122 Jul 15 20:38:14.575737 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User: tempest-DeleteServersTestJSON-1313573122-project Jul 15 20:38:14.575737 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Domain-Id: default Jul 15 20:38:14.575737 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Domain-Name: Default Jul 15 20:38:14.575737 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Id: 1f231f706d2f4d3e9070105bb5981cec Jul 15 20:38:14.575737 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Name: tempest-DeleteServersTestJSON-1313573122-project Jul 15 20:38:14.575737 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: method: > Jul 15 20:38:14.575737 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: exception: Instance 31e74255-0b4d-4c43-91ce-ffccffdc2188 could not be found. Jul 15 20:38:14.575737 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: action_args: {'id': '31e74255-0b4d-4c43-91ce-ffccffdc2188'} Jul 15 20:38:14.576417 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 20:38:14.576417 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:38:14.576417 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 20:38:14.576417 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 20:38:14.576417 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 20:38:14.576417 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 20:38:14.576417 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 20:38:14.576417 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 20:38:14.576417 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 20:38:14.576417 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 20:38:14.576417 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31e74255-0b4d-4c43-91ce-ffccffdc2188 could not be found. Jul 15 20:38:14.576417 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:38:14.576417 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:38:14.576417 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:38:14.576417 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:38:14.576417 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:38:14.576417 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:38:14.576417 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 20:38:14.576417 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 20:38:14.576417 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 20:38:14.577440 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 20:38:14.577440 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 20:38:14.577440 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 20:38:14.577440 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 20:38:14.577440 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 20:38:14.577440 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 20:38:14.577440 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 20:38:14.577440 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31e74255-0b4d-4c43-91ce-ffccffdc2188 could not be found. Jul 15 20:38:14.577440 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:38:14.577440 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:38:14.577440 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:38:14.577440 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:38:14.577440 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:38:14.577440 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:38:14.577440 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 20:38:14.577440 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 20:38:14.577440 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31e74255-0b4d-4c43-91ce-ffccffdc2188 could not be found. Jul 15 20:38:14.577440 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:38:14.582119 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-59daef83-73be-4fd5-8650-024a2cd6fd96 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] Returning 404 to user: Instance 31e74255-0b4d-4c43-91ce-ffccffdc2188 could not be found. {{(pid=124430) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 20:38:14.584326 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-59daef83-73be-4fd5-8650-024a2cd6fd96 tempest-DeleteServersTestJSON-1313573122 tempest-DeleteServersTestJSON-1313573122-project] 10.222.0.66 "GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188" status: 404 len: 111 microversion: 2.1 time: 0.052101 Jul 15 20:38:14.585066 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 90/179] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:14 2022] GET /compute/v2.1/servers/31e74255-0b4d-4c43-91ce-ffccffdc2188 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 20:38:14.593443 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-61555057-13a1-4e1d-b138-b6094929a91a tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:14.594158 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-61555057-13a1-4e1d-b138-b6094929a91a tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:14.595515 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-61555057-13a1-4e1d-b138-b6094929a91a tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:14.596222 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-61555057-13a1-4e1d-b138-b6094929a91a tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:14.849799 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-61555057-13a1-4e1d-b138-b6094929a91a tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:14.858193 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-61555057-13a1-4e1d-b138-b6094929a91a tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc" status: 200 len: 1522 microversion: 2.1 time: 0.296899 Jul 15 20:38:14.860157 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 90/180] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:14 2022] GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc => generated 1522 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:15.181179 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-531e1d31-7727-4efb-8a8c-9140c0c1af35 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:15.181787 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-531e1d31-7727-4efb-8a8c-9140c0c1af35 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] [instance: 3839ab3a-cad8-488a-bbed-4f7c792b804e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:15.190970 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-531e1d31-7727-4efb-8a8c-9140c0c1af35 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:15.191561 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-531e1d31-7727-4efb-8a8c-9140c0c1af35 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:15.192805 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-531e1d31-7727-4efb-8a8c-9140c0c1af35 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:15.193309 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-531e1d31-7727-4efb-8a8c-9140c0c1af35 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:15.469780 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-531e1d31-7727-4efb-8a8c-9140c0c1af35 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932ad1f03da24593a6ad444f6cb95e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129a35d484445db9e141028b2e77497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:15.479093 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-531e1d31-7727-4efb-8a8c-9140c0c1af35 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] 10.222.0.66 "GET /compute/v2.1/servers/3839ab3a-cad8-488a-bbed-4f7c792b804e" status: 200 len: 1314 microversion: 2.1 time: 0.301808 Jul 15 20:38:15.480228 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 91/181] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:15 2022] GET /compute/v2.1/servers/3839ab3a-cad8-488a-bbed-4f7c792b804e => generated 1314 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:15.878907 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-551c14a3-d87c-4296-9384-78be87b1db61 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:15.880119 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-551c14a3-d87c-4296-9384-78be87b1db61 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:15.890367 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-551c14a3-d87c-4296-9384-78be87b1db61 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:15.891627 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-551c14a3-d87c-4296-9384-78be87b1db61 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:15.895837 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-551c14a3-d87c-4296-9384-78be87b1db61 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:15.896917 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-551c14a3-d87c-4296-9384-78be87b1db61 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:16.295238 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-551c14a3-d87c-4296-9384-78be87b1db61 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:16.310331 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-551c14a3-d87c-4296-9384-78be87b1db61 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc" status: 200 len: 1522 microversion: 2.1 time: 0.437044 Jul 15 20:38:16.312301 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 91/182] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:15 2022] GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc => generated 1522 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:16.497351 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-11bd604a-a797-483f-b276-eb9307200c8a tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:16.498981 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-11bd604a-a797-483f-b276-eb9307200c8a tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] [instance: 3839ab3a-cad8-488a-bbed-4f7c792b804e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:16.511907 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-11bd604a-a797-483f-b276-eb9307200c8a tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:16.513281 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-11bd604a-a797-483f-b276-eb9307200c8a tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:16.514201 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-11bd604a-a797-483f-b276-eb9307200c8a tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:16.514662 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-11bd604a-a797-483f-b276-eb9307200c8a tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:16.811115 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-11bd604a-a797-483f-b276-eb9307200c8a tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932ad1f03da24593a6ad444f6cb95e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129a35d484445db9e141028b2e77497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:16.829916 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-11bd604a-a797-483f-b276-eb9307200c8a tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] 10.222.0.66 "GET /compute/v2.1/servers/3839ab3a-cad8-488a-bbed-4f7c792b804e" status: 200 len: 1314 microversion: 2.1 time: 0.336684 Jul 15 20:38:16.839001 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 92/183] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:16 2022] GET /compute/v2.1/servers/3839ab3a-cad8-488a-bbed-4f7c792b804e => generated 1314 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:17.329676 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-c4ff2644-8f9d-41bd-a743-a418f1d7386c tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:17.330557 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-c4ff2644-8f9d-41bd-a743-a418f1d7386c tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:17.344812 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c4ff2644-8f9d-41bd-a743-a418f1d7386c tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:17.345650 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c4ff2644-8f9d-41bd-a743-a418f1d7386c tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:17.346764 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c4ff2644-8f9d-41bd-a743-a418f1d7386c tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:17.348369 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c4ff2644-8f9d-41bd-a743-a418f1d7386c tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:17.659447 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-c4ff2644-8f9d-41bd-a743-a418f1d7386c tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:17.671819 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-c4ff2644-8f9d-41bd-a743-a418f1d7386c tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc" status: 200 len: 1522 microversion: 2.1 time: 0.346537 Jul 15 20:38:17.673565 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 92/184] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:17 2022] GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc => generated 1522 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:17.857114 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-974bfb30-47a2-4b14-a433-0809e47f314e tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:17.857720 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-974bfb30-47a2-4b14-a433-0809e47f314e tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] [instance: 3839ab3a-cad8-488a-bbed-4f7c792b804e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:17.870184 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-974bfb30-47a2-4b14-a433-0809e47f314e tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:17.871033 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-974bfb30-47a2-4b14-a433-0809e47f314e tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:17.872207 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-974bfb30-47a2-4b14-a433-0809e47f314e tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:17.872993 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-974bfb30-47a2-4b14-a433-0809e47f314e tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:18.069618 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-974bfb30-47a2-4b14-a433-0809e47f314e tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932ad1f03da24593a6ad444f6cb95e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129a35d484445db9e141028b2e77497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:18.079835 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-974bfb30-47a2-4b14-a433-0809e47f314e tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] 10.222.0.66 "GET /compute/v2.1/servers/3839ab3a-cad8-488a-bbed-4f7c792b804e" status: 200 len: 1314 microversion: 2.1 time: 0.226661 Jul 15 20:38:18.080923 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 93/185] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:17 2022] GET /compute/v2.1/servers/3839ab3a-cad8-488a-bbed-4f7c792b804e => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:18.690364 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-cc879750-9d79-41cd-9455-8ac67ff1fe2c tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:18.691466 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-cc879750-9d79-41cd-9455-8ac67ff1fe2c tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:18.698937 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-cc879750-9d79-41cd-9455-8ac67ff1fe2c tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:18.699505 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-cc879750-9d79-41cd-9455-8ac67ff1fe2c tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:18.700495 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-cc879750-9d79-41cd-9455-8ac67ff1fe2c tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:18.701079 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-cc879750-9d79-41cd-9455-8ac67ff1fe2c tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:18.855404 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-cc879750-9d79-41cd-9455-8ac67ff1fe2c tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:18.863695 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-cc879750-9d79-41cd-9455-8ac67ff1fe2c tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc" status: 200 len: 1522 microversion: 2.1 time: 0.177950 Jul 15 20:38:18.864271 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 93/186] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:18 2022] GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:19.098660 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-cf6ec04c-63d1-4973-b59d-4026ab0022ef tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:19.099482 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-cf6ec04c-63d1-4973-b59d-4026ab0022ef tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] [instance: 3839ab3a-cad8-488a-bbed-4f7c792b804e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:19.106663 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-cf6ec04c-63d1-4973-b59d-4026ab0022ef tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:19.107827 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-cf6ec04c-63d1-4973-b59d-4026ab0022ef tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:19.108842 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-cf6ec04c-63d1-4973-b59d-4026ab0022ef tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:19.109650 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-cf6ec04c-63d1-4973-b59d-4026ab0022ef tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:19.114368 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_cell1:SELECT=100 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:19.253952 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-cf6ec04c-63d1-4973-b59d-4026ab0022ef tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932ad1f03da24593a6ad444f6cb95e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129a35d484445db9e141028b2e77497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:19.262576 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-cf6ec04c-63d1-4973-b59d-4026ab0022ef tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] 10.222.0.66 "GET /compute/v2.1/servers/3839ab3a-cad8-488a-bbed-4f7c792b804e" status: 200 len: 1314 microversion: 2.1 time: 0.168658 Jul 15 20:38:19.263149 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 94/187] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:19 2022] GET /compute/v2.1/servers/3839ab3a-cad8-488a-bbed-4f7c792b804e => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:19.880501 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-a72b12e6-cbdf-4e91-97df-5cbb9b465737 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:19.881139 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-a72b12e6-cbdf-4e91-97df-5cbb9b465737 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:19.887472 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a72b12e6-cbdf-4e91-97df-5cbb9b465737 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:19.887918 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a72b12e6-cbdf-4e91-97df-5cbb9b465737 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:19.888776 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a72b12e6-cbdf-4e91-97df-5cbb9b465737 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:19.889211 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a72b12e6-cbdf-4e91-97df-5cbb9b465737 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:19.908895 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell1:SELECT=100 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:20.035221 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-a72b12e6-cbdf-4e91-97df-5cbb9b465737 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:20.044564 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-a72b12e6-cbdf-4e91-97df-5cbb9b465737 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc" status: 200 len: 1522 microversion: 2.1 time: 0.167898 Jul 15 20:38:20.045570 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 94/188] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:19 2022] GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:20.280994 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-0657d980-fd9a-4b9d-8a2a-76d9d19a7972 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:20.281719 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-0657d980-fd9a-4b9d-8a2a-76d9d19a7972 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] [instance: 3839ab3a-cad8-488a-bbed-4f7c792b804e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:20.289217 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-0657d980-fd9a-4b9d-8a2a-76d9d19a7972 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:20.289661 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-0657d980-fd9a-4b9d-8a2a-76d9d19a7972 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:20.290422 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-0657d980-fd9a-4b9d-8a2a-76d9d19a7972 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:20.290849 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-0657d980-fd9a-4b9d-8a2a-76d9d19a7972 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:20.437275 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-0657d980-fd9a-4b9d-8a2a-76d9d19a7972 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932ad1f03da24593a6ad444f6cb95e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129a35d484445db9e141028b2e77497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:20.446121 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-0657d980-fd9a-4b9d-8a2a-76d9d19a7972 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] 10.222.0.66 "GET /compute/v2.1/servers/3839ab3a-cad8-488a-bbed-4f7c792b804e" status: 200 len: 1314 microversion: 2.1 time: 0.169034 Jul 15 20:38:20.447239 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 95/189] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:20 2022] GET /compute/v2.1/servers/3839ab3a-cad8-488a-bbed-4f7c792b804e => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:20.698784 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-d95e41c5-a4cd-4dfc-a6ba-24d3ceaabbbf req-a557f05a-10a9-48da-9557-71392d3dec6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3839ab3a-cad8-488a-bbed-4f7c792b804e", "name": "network-vif-plugged", "status": "completed", "tag": "c40927c0-fac9-4c62-9a5f-0099d8d055d7"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:38:20.707367 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-d95e41c5-a4cd-4dfc-a6ba-24d3ceaabbbf req-a557f05a-10a9-48da-9557-71392d3dec6e service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:20.708199 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-d95e41c5-a4cd-4dfc-a6ba-24d3ceaabbbf req-a557f05a-10a9-48da-9557-71392d3dec6e service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:20.720050 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-d95e41c5-a4cd-4dfc-a6ba-24d3ceaabbbf req-a557f05a-10a9-48da-9557-71392d3dec6e service nova] Creating event network-vif-plugged:c40927c0-fac9-4c62-9a5f-0099d8d055d7 for instance 3839ab3a-cad8-488a-bbed-4f7c792b804e on hv-cinder-79987 Jul 15 20:38:20.725217 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-d95e41c5-a4cd-4dfc-a6ba-24d3ceaabbbf req-a557f05a-10a9-48da-9557-71392d3dec6e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030612 Jul 15 20:38:20.726122 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 95/190] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:38:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:38:21.063749 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-32ddfc84-1d03-4a1d-9924-c9bad3040ae9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:21.064617 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-32ddfc84-1d03-4a1d-9924-c9bad3040ae9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:21.071496 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-32ddfc84-1d03-4a1d-9924-c9bad3040ae9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:21.072019 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-32ddfc84-1d03-4a1d-9924-c9bad3040ae9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:21.072904 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-32ddfc84-1d03-4a1d-9924-c9bad3040ae9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:21.073402 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-32ddfc84-1d03-4a1d-9924-c9bad3040ae9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:21.134129 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-029c017d-50a2-4f8e-8382-a16cb1fefe94 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-976146214", "imageRef": "a759604a-67e3-4c79-b848-5d03d936d7a0", "flavorRef": "452", "networks": [{"uuid": "1d4f92ae-9a3b-4eab-9e7b-eb670ca1dcff"}]}} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:38:21.191285 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.network.neutron [None req-029c017d-50a2-4f8e-8382-a16cb1fefe94 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] validate_networks() for [('1d4f92ae-9a3b-4eab-9e7b-eb670ca1dcff', None, None, None, None, None)] {{(pid=124432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 20:38:21.264146 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-32ddfc84-1d03-4a1d-9924-c9bad3040ae9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:21.274951 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-32ddfc84-1d03-4a1d-9924-c9bad3040ae9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc" status: 200 len: 1522 microversion: 2.1 time: 0.216390 Jul 15 20:38:21.285610 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 96/191] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:21 2022] GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:21.469678 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-54fcc3ac-8af6-4047-8cf1-d984f8b85214 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:21.470329 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-54fcc3ac-8af6-4047-8cf1-d984f8b85214 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] [instance: 3839ab3a-cad8-488a-bbed-4f7c792b804e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:21.477517 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-54fcc3ac-8af6-4047-8cf1-d984f8b85214 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:21.478221 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-54fcc3ac-8af6-4047-8cf1-d984f8b85214 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:21.479691 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-54fcc3ac-8af6-4047-8cf1-d984f8b85214 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:21.480338 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-54fcc3ac-8af6-4047-8cf1-d984f8b85214 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:21.731665 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-54fcc3ac-8af6-4047-8cf1-d984f8b85214 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932ad1f03da24593a6ad444f6cb95e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129a35d484445db9e141028b2e77497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:21.741356 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-54fcc3ac-8af6-4047-8cf1-d984f8b85214 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] 10.222.0.66 "GET /compute/v2.1/servers/3839ab3a-cad8-488a-bbed-4f7c792b804e" status: 200 len: 1314 microversion: 2.1 time: 0.277779 Jul 15 20:38:21.745257 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 97/192] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:21 2022] GET /compute/v2.1/servers/3839ab3a-cad8-488a-bbed-4f7c792b804e => generated 1314 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:21.886190 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-029c017d-50a2-4f8e-8382-a16cb1fefe94 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Flavor limits 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 20:38:21.887269 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-029c017d-50a2-4f8e-8382-a16cb1fefe94 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Image limits 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 20:38:21.887981 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-029c017d-50a2-4f8e-8382-a16cb1fefe94 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Flavor pref 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 20:38:21.888581 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-029c017d-50a2-4f8e-8382-a16cb1fefe94 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Image pref 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 20:38:21.889151 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-029c017d-50a2-4f8e-8382-a16cb1fefe94 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 20:38:21.906895 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-029c017d-50a2-4f8e-8382-a16cb1fefe94 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:21.907882 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-029c017d-50a2-4f8e-8382-a16cb1fefe94 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:21.909314 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-029c017d-50a2-4f8e-8382-a16cb1fefe94 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:21.910038 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-029c017d-50a2-4f8e-8382-a16cb1fefe94 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:21.939208 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-029c017d-50a2-4f8e-8382-a16cb1fefe94 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Getting quotas for project 1e9f9e0f8edb42848965b3c6141e88d0. Resources: {'instances', 'ram', 'cores'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 20:38:21.944825 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-029c017d-50a2-4f8e-8382-a16cb1fefe94 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Getting quotas for user 145cee1016d349ceb93323a170bc957e and project 1e9f9e0f8edb42848965b3c6141e88d0. Resources: {'instances', 'ram', 'cores'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 20:38:21.964904 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-029c017d-50a2-4f8e-8382-a16cb1fefe94 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Going to run 1 instances... {{(pid=124432) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 20:38:21.967764 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-029c017d-50a2-4f8e-8382-a16cb1fefe94 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] [instance: 0d0462a7-7852-48bd-80ae-c0f1a5a93dfc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a759604a-67e3-4c79-b848-5d03d936d7a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 20:38:22.033897 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-029c017d-50a2-4f8e-8382-a16cb1fefe94 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.904028 Jul 15 20:38:22.034689 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 96/193] 10.222.0.66 () {60 vars in 1146 bytes} [Fri Jul 15 20:38:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 906 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 15 20:38:22.046312 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-47704bbf-941f-47a6-8b3f-bdb61c5308bc tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:22.047085 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-47704bbf-941f-47a6-8b3f-bdb61c5308bc tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] [instance: 0d0462a7-7852-48bd-80ae-c0f1a5a93dfc] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:22.176048 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-47704bbf-941f-47a6-8b3f-bdb61c5308bc tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145cee1016d349ceb93323a170bc957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f9e0f8edb42848965b3c6141e88d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:22.183528 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-47704bbf-941f-47a6-8b3f-bdb61c5308bc tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] 10.222.0.66 "GET /compute/v2.1/servers/0d0462a7-7852-48bd-80ae-c0f1a5a93dfc" status: 200 len: 1218 microversion: 2.1 time: 0.142340 Jul 15 20:38:22.194199 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 98/194] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:22 2022] GET /compute/v2.1/servers/0d0462a7-7852-48bd-80ae-c0f1a5a93dfc => generated 1218 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:22.296382 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-2e92b24f-5e3d-40b2-939c-29fc0af02276 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:22.298503 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-2e92b24f-5e3d-40b2-939c-29fc0af02276 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:22.314862 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2e92b24f-5e3d-40b2-939c-29fc0af02276 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:22.318460 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2e92b24f-5e3d-40b2-939c-29fc0af02276 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:22.320232 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2e92b24f-5e3d-40b2-939c-29fc0af02276 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:22.321987 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2e92b24f-5e3d-40b2-939c-29fc0af02276 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:22.693166 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-2e92b24f-5e3d-40b2-939c-29fc0af02276 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:22.727573 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-2e92b24f-5e3d-40b2-939c-29fc0af02276 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc" status: 200 len: 1522 microversion: 2.1 time: 0.436228 Jul 15 20:38:22.730366 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 97/195] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:22 2022] GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc => generated 1522 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:22.764512 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-83292927-2120-41d0-b89c-566955c41297 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:22.765221 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-83292927-2120-41d0-b89c-566955c41297 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] [instance: 3839ab3a-cad8-488a-bbed-4f7c792b804e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:22.785516 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-83292927-2120-41d0-b89c-566955c41297 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:22.786089 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-83292927-2120-41d0-b89c-566955c41297 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:22.787024 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-83292927-2120-41d0-b89c-566955c41297 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:22.787463 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-83292927-2120-41d0-b89c-566955c41297 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:23.074182 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-83292927-2120-41d0-b89c-566955c41297 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932ad1f03da24593a6ad444f6cb95e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129a35d484445db9e141028b2e77497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:23.096554 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-83292927-2120-41d0-b89c-566955c41297 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] 10.222.0.66 "GET /compute/v2.1/servers/3839ab3a-cad8-488a-bbed-4f7c792b804e" status: 200 len: 1314 microversion: 2.1 time: 0.323653 Jul 15 20:38:23.099859 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 99/196] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:22 2022] GET /compute/v2.1/servers/3839ab3a-cad8-488a-bbed-4f7c792b804e => generated 1314 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:23.202181 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-697901ba-fd57-44fe-a201-2f8ce5ca4aaf tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:23.203533 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-697901ba-fd57-44fe-a201-2f8ce5ca4aaf tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] [instance: 0d0462a7-7852-48bd-80ae-c0f1a5a93dfc] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:23.207568 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=6 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:23.214099 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-697901ba-fd57-44fe-a201-2f8ce5ca4aaf tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:23.215152 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-697901ba-fd57-44fe-a201-2f8ce5ca4aaf tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:23.216147 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-697901ba-fd57-44fe-a201-2f8ce5ca4aaf tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:23.216803 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-697901ba-fd57-44fe-a201-2f8ce5ca4aaf tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:23.327039 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-697901ba-fd57-44fe-a201-2f8ce5ca4aaf tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145cee1016d349ceb93323a170bc957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f9e0f8edb42848965b3c6141e88d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:23.336001 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-697901ba-fd57-44fe-a201-2f8ce5ca4aaf tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] 10.222.0.66 "GET /compute/v2.1/servers/0d0462a7-7852-48bd-80ae-c0f1a5a93dfc" status: 200 len: 1270 microversion: 2.1 time: 0.139122 Jul 15 20:38:23.336874 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 98/197] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:23 2022] GET /compute/v2.1/servers/0d0462a7-7852-48bd-80ae-c0f1a5a93dfc => generated 1270 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:23.746394 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-30f5f0ac-7486-4c19-b835-1a4edfdac7ad tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:23.746926 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-30f5f0ac-7486-4c19-b835-1a4edfdac7ad tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:23.754104 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-30f5f0ac-7486-4c19-b835-1a4edfdac7ad tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:23.754934 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-30f5f0ac-7486-4c19-b835-1a4edfdac7ad tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:23.755953 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-30f5f0ac-7486-4c19-b835-1a4edfdac7ad tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:23.756488 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-30f5f0ac-7486-4c19-b835-1a4edfdac7ad tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:23.923787 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-30f5f0ac-7486-4c19-b835-1a4edfdac7ad tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:23.931844 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-30f5f0ac-7486-4c19-b835-1a4edfdac7ad tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc" status: 200 len: 1522 microversion: 2.1 time: 0.189348 Jul 15 20:38:23.932505 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 100/198] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:23 2022] GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:24.116246 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-b036bd7e-5308-4050-8fe2-1c7aa7695e3f tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:24.116984 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-b036bd7e-5308-4050-8fe2-1c7aa7695e3f tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] [instance: 3839ab3a-cad8-488a-bbed-4f7c792b804e] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:24.129933 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b036bd7e-5308-4050-8fe2-1c7aa7695e3f tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:24.131161 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b036bd7e-5308-4050-8fe2-1c7aa7695e3f tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:24.133548 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b036bd7e-5308-4050-8fe2-1c7aa7695e3f tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:24.135109 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b036bd7e-5308-4050-8fe2-1c7aa7695e3f tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:24.354267 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-982cccde-2256-4f6d-94da-e44399a4d0e7 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:24.355285 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-982cccde-2256-4f6d-94da-e44399a4d0e7 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] [instance: 0d0462a7-7852-48bd-80ae-c0f1a5a93dfc] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:24.377836 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-982cccde-2256-4f6d-94da-e44399a4d0e7 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:24.380928 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-982cccde-2256-4f6d-94da-e44399a4d0e7 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:24.385207 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-982cccde-2256-4f6d-94da-e44399a4d0e7 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:24.386414 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-982cccde-2256-4f6d-94da-e44399a4d0e7 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:24.532500 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-b036bd7e-5308-4050-8fe2-1c7aa7695e3f tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932ad1f03da24593a6ad444f6cb95e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129a35d484445db9e141028b2e77497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:24.547330 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-b036bd7e-5308-4050-8fe2-1c7aa7695e3f tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] 10.222.0.66 "GET /compute/v2.1/servers/3839ab3a-cad8-488a-bbed-4f7c792b804e" status: 200 len: 1498 microversion: 2.1 time: 0.433760 Jul 15 20:38:24.573979 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 99/199] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:24 2022] GET /compute/v2.1/servers/3839ab3a-cad8-488a-bbed-4f7c792b804e => generated 1498 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:24.624757 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-982cccde-2256-4f6d-94da-e44399a4d0e7 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145cee1016d349ceb93323a170bc957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f9e0f8edb42848965b3c6141e88d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:24.637854 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-982cccde-2256-4f6d-94da-e44399a4d0e7 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] 10.222.0.66 "GET /compute/v2.1/servers/0d0462a7-7852-48bd-80ae-c0f1a5a93dfc" status: 200 len: 1276 microversion: 2.1 time: 0.287762 Jul 15 20:38:24.639462 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 101/200] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:24 2022] GET /compute/v2.1/servers/0d0462a7-7852-48bd-80ae-c0f1a5a93dfc => generated 1276 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:24.954066 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-adf6d992-8f26-49a7-bee8-983ca98c6f52 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:24.954721 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-adf6d992-8f26-49a7-bee8-983ca98c6f52 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:24.995680 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-adf6d992-8f26-49a7-bee8-983ca98c6f52 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:24.997817 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-adf6d992-8f26-49a7-bee8-983ca98c6f52 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:24.998655 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-adf6d992-8f26-49a7-bee8-983ca98c6f52 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:24.999097 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-adf6d992-8f26-49a7-bee8-983ca98c6f52 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:25.364927 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-3d0fef00-220b-4af8-a54c-00ac77c327da tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:25.367040 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-3d0fef00-220b-4af8-a54c-00ac77c327da tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] [instance: 3839ab3a-cad8-488a-bbed-4f7c792b804e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:25.390100 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:25.395898 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-3d0fef00-220b-4af8-a54c-00ac77c327da tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:25.397826 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-3d0fef00-220b-4af8-a54c-00ac77c327da tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:25.401079 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-3d0fef00-220b-4af8-a54c-00ac77c327da tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:25.401791 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-3d0fef00-220b-4af8-a54c-00ac77c327da tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:25.428222 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-adf6d992-8f26-49a7-bee8-983ca98c6f52 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:25.440120 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-adf6d992-8f26-49a7-bee8-983ca98c6f52 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc" status: 200 len: 1522 microversion: 2.1 time: 0.489877 Jul 15 20:38:25.440784 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 100/201] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:24 2022] GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc => generated 1522 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:25.481039 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-3d0fef00-220b-4af8-a54c-00ac77c327da tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] [instance: 3839ab3a-cad8-488a-bbed-4f7c792b804e] Going to try to terminate instance {{(pid=124430) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 20:38:25.656860 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-72bea89b-527b-42d4-a3aa-4ddf579db1a1 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:25.657828 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-72bea89b-527b-42d4-a3aa-4ddf579db1a1 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] [instance: 0d0462a7-7852-48bd-80ae-c0f1a5a93dfc] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:25.673458 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-72bea89b-527b-42d4-a3aa-4ddf579db1a1 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:25.673999 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-72bea89b-527b-42d4-a3aa-4ddf579db1a1 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:25.674957 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-72bea89b-527b-42d4-a3aa-4ddf579db1a1 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:25.675459 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-72bea89b-527b-42d4-a3aa-4ddf579db1a1 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:25.677278 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-3d0fef00-220b-4af8-a54c-00ac77c327da tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] 10.222.0.66 "DELETE /compute/v2.1/servers/3839ab3a-cad8-488a-bbed-4f7c792b804e" status: 204 len: 0 microversion: 2.1 time: 0.316514 Jul 15 20:38:25.678463 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 102/202] 10.222.0.66 () {58 vars in 1238 bytes} [Fri Jul 15 20:38:25 2022] DELETE /compute/v2.1/servers/3839ab3a-cad8-488a-bbed-4f7c792b804e => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 20:38:25.691112 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-359b2bba-7830-4f00-8cca-a3e98eb1a22e tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:25.691827 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-359b2bba-7830-4f00-8cca-a3e98eb1a22e tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] [instance: 3839ab3a-cad8-488a-bbed-4f7c792b804e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:25.707056 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-359b2bba-7830-4f00-8cca-a3e98eb1a22e tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:25.707505 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-359b2bba-7830-4f00-8cca-a3e98eb1a22e tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:25.709759 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-359b2bba-7830-4f00-8cca-a3e98eb1a22e tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:25.713526 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-359b2bba-7830-4f00-8cca-a3e98eb1a22e tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:26.070972 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-72bea89b-527b-42d4-a3aa-4ddf579db1a1 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145cee1016d349ceb93323a170bc957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f9e0f8edb42848965b3c6141e88d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:26.083584 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-72bea89b-527b-42d4-a3aa-4ddf579db1a1 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] 10.222.0.66 "GET /compute/v2.1/servers/0d0462a7-7852-48bd-80ae-c0f1a5a93dfc" status: 200 len: 1318 microversion: 2.1 time: 0.429010 Jul 15 20:38:26.092802 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 101/203] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:25 2022] GET /compute/v2.1/servers/0d0462a7-7852-48bd-80ae-c0f1a5a93dfc => generated 1318 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:38:26.216357 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-359b2bba-7830-4f00-8cca-a3e98eb1a22e tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932ad1f03da24593a6ad444f6cb95e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129a35d484445db9e141028b2e77497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:26.229080 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-359b2bba-7830-4f00-8cca-a3e98eb1a22e tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] 10.222.0.66 "GET /compute/v2.1/servers/3839ab3a-cad8-488a-bbed-4f7c792b804e" status: 200 len: 1504 microversion: 2.1 time: 0.545439 Jul 15 20:38:26.231407 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 103/204] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:25 2022] GET /compute/v2.1/servers/3839ab3a-cad8-488a-bbed-4f7c792b804e => generated 1504 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:26.461606 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-995df93e-7e37-4d44-9731-0c7b9b654e32 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:26.462526 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-995df93e-7e37-4d44-9731-0c7b9b654e32 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:26.475393 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-995df93e-7e37-4d44-9731-0c7b9b654e32 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:26.476121 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-995df93e-7e37-4d44-9731-0c7b9b654e32 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:26.477140 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-995df93e-7e37-4d44-9731-0c7b9b654e32 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:26.477779 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-995df93e-7e37-4d44-9731-0c7b9b654e32 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:26.801960 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-995df93e-7e37-4d44-9731-0c7b9b654e32 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:26.839537 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-995df93e-7e37-4d44-9731-0c7b9b654e32 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc" status: 200 len: 1522 microversion: 2.1 time: 0.379250 Jul 15 20:38:26.844285 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 102/205] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:26 2022] GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc => generated 1522 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:27.104597 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-09b17097-215f-4f66-ba8d-c71b4f1be7f4 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:27.105285 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-09b17097-215f-4f66-ba8d-c71b4f1be7f4 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] [instance: 0d0462a7-7852-48bd-80ae-c0f1a5a93dfc] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:27.120187 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-09b17097-215f-4f66-ba8d-c71b4f1be7f4 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:27.121088 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-09b17097-215f-4f66-ba8d-c71b4f1be7f4 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:27.122333 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-09b17097-215f-4f66-ba8d-c71b4f1be7f4 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:27.123776 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-09b17097-215f-4f66-ba8d-c71b4f1be7f4 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:27.253476 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-f9116b5c-58f5-4919-a17d-6054859c3715 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:27.254200 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-f9116b5c-58f5-4919-a17d-6054859c3715 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] [instance: 3839ab3a-cad8-488a-bbed-4f7c792b804e] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:27.290942 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f9116b5c-58f5-4919-a17d-6054859c3715 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:27.292136 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f9116b5c-58f5-4919-a17d-6054859c3715 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:27.293512 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f9116b5c-58f5-4919-a17d-6054859c3715 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:27.294430 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f9116b5c-58f5-4919-a17d-6054859c3715 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:27.412832 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-09b17097-215f-4f66-ba8d-c71b4f1be7f4 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145cee1016d349ceb93323a170bc957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f9e0f8edb42848965b3c6141e88d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:27.427305 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-09b17097-215f-4f66-ba8d-c71b4f1be7f4 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] 10.222.0.66 "GET /compute/v2.1/servers/0d0462a7-7852-48bd-80ae-c0f1a5a93dfc" status: 200 len: 1318 microversion: 2.1 time: 0.330214 Jul 15 20:38:27.437305 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 104/206] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:27 2022] GET /compute/v2.1/servers/0d0462a7-7852-48bd-80ae-c0f1a5a93dfc => generated 1318 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:27.659193 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-f9116b5c-58f5-4919-a17d-6054859c3715 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932ad1f03da24593a6ad444f6cb95e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129a35d484445db9e141028b2e77497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:27.671065 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-f9116b5c-58f5-4919-a17d-6054859c3715 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] 10.222.0.66 "GET /compute/v2.1/servers/3839ab3a-cad8-488a-bbed-4f7c792b804e" status: 200 len: 1504 microversion: 2.1 time: 0.427682 Jul 15 20:38:27.676757 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 103/207] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:27 2022] GET /compute/v2.1/servers/3839ab3a-cad8-488a-bbed-4f7c792b804e => generated 1504 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:38:27.859003 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-f3d05ee2-49d4-4fc7-92d1-d5f92ff4f6d1 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:27.859651 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-f3d05ee2-49d4-4fc7-92d1-d5f92ff4f6d1 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:27.877597 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-f3d05ee2-49d4-4fc7-92d1-d5f92ff4f6d1 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:27.879017 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-f3d05ee2-49d4-4fc7-92d1-d5f92ff4f6d1 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:27.879979 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-f3d05ee2-49d4-4fc7-92d1-d5f92ff4f6d1 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:27.880635 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-f3d05ee2-49d4-4fc7-92d1-d5f92ff4f6d1 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:28.102230 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-f3d05ee2-49d4-4fc7-92d1-d5f92ff4f6d1 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:28.115427 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-f3d05ee2-49d4-4fc7-92d1-d5f92ff4f6d1 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc" status: 200 len: 1522 microversion: 2.1 time: 0.259896 Jul 15 20:38:28.119392 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 105/208] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:27 2022] GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc => generated 1522 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:28.450959 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-ec01d135-e8e8-4701-a3d4-25db5a6dca7c tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:28.451498 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-ec01d135-e8e8-4701-a3d4-25db5a6dca7c tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] [instance: 0d0462a7-7852-48bd-80ae-c0f1a5a93dfc] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:28.474168 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ec01d135-e8e8-4701-a3d4-25db5a6dca7c tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:28.474904 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ec01d135-e8e8-4701-a3d4-25db5a6dca7c tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:28.475886 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ec01d135-e8e8-4701-a3d4-25db5a6dca7c tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:28.476522 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ec01d135-e8e8-4701-a3d4-25db5a6dca7c tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:28.697064 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-cc34b6e6-eb9b-47fc-b395-cafd2e7b071d tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:28.698171 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-cc34b6e6-eb9b-47fc-b395-cafd2e7b071d tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] [instance: 3839ab3a-cad8-488a-bbed-4f7c792b804e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:28.707535 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-cc34b6e6-eb9b-47fc-b395-cafd2e7b071d tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:28.708321 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-cc34b6e6-eb9b-47fc-b395-cafd2e7b071d tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:28.709281 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-cc34b6e6-eb9b-47fc-b395-cafd2e7b071d tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:28.709891 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-cc34b6e6-eb9b-47fc-b395-cafd2e7b071d tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:28.923448 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-ec01d135-e8e8-4701-a3d4-25db5a6dca7c tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145cee1016d349ceb93323a170bc957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f9e0f8edb42848965b3c6141e88d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:28.931867 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-ec01d135-e8e8-4701-a3d4-25db5a6dca7c tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] 10.222.0.66 "GET /compute/v2.1/servers/0d0462a7-7852-48bd-80ae-c0f1a5a93dfc" status: 200 len: 1318 microversion: 2.1 time: 0.484838 Jul 15 20:38:28.932471 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 104/209] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:28 2022] GET /compute/v2.1/servers/0d0462a7-7852-48bd-80ae-c0f1a5a93dfc => generated 1318 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:29.055709 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-cc34b6e6-eb9b-47fc-b395-cafd2e7b071d tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932ad1f03da24593a6ad444f6cb95e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129a35d484445db9e141028b2e77497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:29.059209 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-cc34b6e6-eb9b-47fc-b395-cafd2e7b071d tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] 10.222.0.66 "GET /compute/v2.1/servers/3839ab3a-cad8-488a-bbed-4f7c792b804e" status: 200 len: 1504 microversion: 2.1 time: 0.367956 Jul 15 20:38:29.069654 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 106/210] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:28 2022] GET /compute/v2.1/servers/3839ab3a-cad8-488a-bbed-4f7c792b804e => generated 1504 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:29.107600 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-8ee672d4-284b-4c7d-813f-b6147861c43b tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Action: 'create', calling method: .version_select at 0x7ff5185f35e0>, body: {"keypair": {"name": "tempest-keypair-211388367", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/ybz6v6k0dYE26Vnnxe//PmXZQ59CQ6GoYtmxc1pHbxb3fjxmV391s0Fr+EJPckXQkWKSpzojR51y0mTFhRBsrb/ty+5UnbiPXa8Iy3/3w8oU1dl8NPJOORmL3hlBBPQ=="}} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:38:29.135285 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-f5e85f93-f228-48f1-aeec-c950bdde75aa tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:29.137232 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-f5e85f93-f228-48f1-aeec-c950bdde75aa tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:29.155412 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-f5e85f93-f228-48f1-aeec-c950bdde75aa tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:29.156022 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-f5e85f93-f228-48f1-aeec-c950bdde75aa tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:29.159185 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-8ee672d4-284b-4c7d-813f-b6147861c43b tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Getting quotas for project 9af209f962144de4ae7e3575a3890096. Resources: {'key_pairs'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 20:38:29.165258 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-8ee672d4-284b-4c7d-813f-b6147861c43b tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Getting quotas for user 75d12a685d9b419fa3606b5f4d1309fe and project 9af209f962144de4ae7e3575a3890096. Resources: {'key_pairs'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 20:38:29.169683 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-f5e85f93-f228-48f1-aeec-c950bdde75aa tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:29.170483 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-f5e85f93-f228-48f1-aeec-c950bdde75aa tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:29.251154 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-8ee672d4-284b-4c7d-813f-b6147861c43b tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.314337 Jul 15 20:38:29.252984 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 105/211] 10.222.0.66 () {60 vars in 1158 bytes} [Fri Jul 15 20:38:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:38:29.266682 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-40756f2b-8ec5-4460-ba7d-985fd21cdce5 req-889dd1b1-dd45-448c-aea5-2b4b792f1f20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d0462a7-7852-48bd-80ae-c0f1a5a93dfc", "tag": "b9a5bff9-00b3-434f-b108-d1df2ac35acd"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:38:29.279713 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-40756f2b-8ec5-4460-ba7d-985fd21cdce5 req-889dd1b1-dd45-448c-aea5-2b4b792f1f20 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:29.280166 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-40756f2b-8ec5-4460-ba7d-985fd21cdce5 req-889dd1b1-dd45-448c-aea5-2b4b792f1f20 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:29.314975 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-40756f2b-8ec5-4460-ba7d-985fd21cdce5 req-889dd1b1-dd45-448c-aea5-2b4b792f1f20 service nova] Creating event network-changed:b9a5bff9-00b3-434f-b108-d1df2ac35acd for instance 0d0462a7-7852-48bd-80ae-c0f1a5a93dfc on hv-cinder-79987 Jul 15 20:38:29.347401 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-40756f2b-8ec5-4460-ba7d-985fd21cdce5 req-889dd1b1-dd45-448c-aea5-2b4b792f1f20 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085261 Jul 15 20:38:29.348454 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 106/212] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:38:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:38:29.601150 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-f5e85f93-f228-48f1-aeec-c950bdde75aa tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:29.610853 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-f5e85f93-f228-48f1-aeec-c950bdde75aa tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc" status: 200 len: 1522 microversion: 2.1 time: 0.481735 Jul 15 20:38:29.612166 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 107/213] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:29 2022] GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc => generated 1522 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:38:29.948692 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-c88bcf52-bb5f-4ae1-9cbf-7d0860f806a8 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:29.949866 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-c88bcf52-bb5f-4ae1-9cbf-7d0860f806a8 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] [instance: 0d0462a7-7852-48bd-80ae-c0f1a5a93dfc] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:29.959622 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c88bcf52-bb5f-4ae1-9cbf-7d0860f806a8 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:29.960071 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c88bcf52-bb5f-4ae1-9cbf-7d0860f806a8 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:29.961089 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c88bcf52-bb5f-4ae1-9cbf-7d0860f806a8 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:29.961514 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c88bcf52-bb5f-4ae1-9cbf-7d0860f806a8 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:30.081946 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-bfceab4a-b8d1-479f-8064-e4debfa5a782 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:30.088810 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-bfceab4a-b8d1-479f-8064-e4debfa5a782 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] [instance: 3839ab3a-cad8-488a-bbed-4f7c792b804e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:30.129670 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-bfceab4a-b8d1-479f-8064-e4debfa5a782 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:30.132361 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-bfceab4a-b8d1-479f-8064-e4debfa5a782 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:30.135977 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-bfceab4a-b8d1-479f-8064-e4debfa5a782 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:30.137633 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-bfceab4a-b8d1-479f-8064-e4debfa5a782 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:30.208011 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.wsgi [None req-bfceab4a-b8d1-479f-8064-e4debfa5a782 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] HTTP exception thrown: Instance 3839ab3a-cad8-488a-bbed-4f7c792b804e could not be found. Jul 15 20:38:30.214476 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-bfceab4a-b8d1-479f-8064-e4debfa5a782 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Request method failure captured: Jul 15 20:38:30.214476 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: request: GET /compute/v2.1/servers/3839ab3a-cad8-488a-bbed-4f7c792b804e HTTP/1.1 Jul 15 20:38:30.214476 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Accept: application/json Jul 15 20:38:30.214476 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Accept-Encoding: identity Jul 15 20:38:30.214476 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Connection: close Jul 15 20:38:30.214476 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Content-Length: 0 Jul 15 20:38:30.214476 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Content-Type: application/json Jul 15 20:38:30.214476 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Host: 10.222.0.66 Jul 15 20:38:30.214476 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Openstack-System-Scope: None Jul 15 20:38:30.214476 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: User-Agent: python-urllib3/1.26.9 Jul 15 20:38:30.214476 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Auth-Token: gAAAAABi0dAo0JwHkqzrSh_Nl87PnMeAZb6_zGNmshcMxdpuxHmlGCwxVdYqiWW7DS2wcZoqT2-yV8NPOSE5Q0KQWripp-rT6nZzEKdrQ4uYWGG--NkM6GkWasX5sMgE9CJgO5fMAFCO99LgUiuncYA_3Me2cF8zuKQmeKTDME0dKXjRzTCCAcs Jul 15 20:38:30.214476 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Domain-Id: None Jul 15 20:38:30.214476 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Domain-Name: None Jul 15 20:38:30.214476 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Identity-Status: Confirmed Jul 15 20:38:30.214476 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Is-Admin-Project: True Jul 15 20:38:30.214476 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Domain-Id: default Jul 15 20:38:30.214476 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Domain-Name: Default Jul 15 20:38:30.214476 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Id: 3129a35d484445db9e141028b2e77497 Jul 15 20:38:30.214476 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Name: tempest-VolumesActionsTest-537258293 Jul 15 20:38:30.214476 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Role: member,reader Jul 15 20:38:30.214476 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Roles: member,reader Jul 15 20:38:30.216023 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3129a35d484445db9e141028b2e77497"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_3129a35d484445db9e141028b2e77497"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3129a35d484445db9e141028b2e77497"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/3129a35d484445db9e141028b2e77497"}]}] Jul 15 20:38:30.216023 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant: tempest-VolumesActionsTest-537258293 Jul 15 20:38:30.216023 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant-Id: 3129a35d484445db9e141028b2e77497 Jul 15 20:38:30.216023 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant-Name: tempest-VolumesActionsTest-537258293 Jul 15 20:38:30.216023 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User: tempest-VolumesActionsTest-537258293-project Jul 15 20:38:30.216023 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Domain-Id: default Jul 15 20:38:30.216023 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Domain-Name: Default Jul 15 20:38:30.216023 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Id: 932ad1f03da24593a6ad444f6cb95e6d Jul 15 20:38:30.216023 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Name: tempest-VolumesActionsTest-537258293-project Jul 15 20:38:30.216023 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: method: > Jul 15 20:38:30.216023 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: exception: Instance 3839ab3a-cad8-488a-bbed-4f7c792b804e could not be found. Jul 15 20:38:30.216023 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: action_args: {'id': '3839ab3a-cad8-488a-bbed-4f7c792b804e'} Jul 15 20:38:30.216932 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 20:38:30.216932 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:38:30.216932 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 20:38:30.216932 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 20:38:30.216932 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 20:38:30.216932 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 20:38:30.216932 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 20:38:30.216932 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 20:38:30.216932 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 20:38:30.216932 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 20:38:30.216932 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3839ab3a-cad8-488a-bbed-4f7c792b804e could not be found. Jul 15 20:38:30.216932 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:38:30.216932 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:38:30.216932 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:38:30.216932 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:38:30.216932 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:38:30.216932 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:38:30.216932 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 20:38:30.216932 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 20:38:30.216932 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 20:38:30.218279 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 20:38:30.218279 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 20:38:30.218279 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 20:38:30.218279 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 20:38:30.218279 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 20:38:30.218279 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 20:38:30.218279 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 20:38:30.218279 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3839ab3a-cad8-488a-bbed-4f7c792b804e could not be found. Jul 15 20:38:30.218279 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:38:30.218279 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:38:30.218279 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:38:30.218279 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:38:30.218279 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:38:30.218279 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:38:30.218279 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 20:38:30.218279 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 20:38:30.218279 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3839ab3a-cad8-488a-bbed-4f7c792b804e could not be found. Jul 15 20:38:30.218279 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:38:30.220335 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-bfceab4a-b8d1-479f-8064-e4debfa5a782 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Returning 404 to user: Instance 3839ab3a-cad8-488a-bbed-4f7c792b804e could not be found. {{(pid=124430) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 20:38:30.220335 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-bfceab4a-b8d1-479f-8064-e4debfa5a782 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] 10.222.0.66 "GET /compute/v2.1/servers/3839ab3a-cad8-488a-bbed-4f7c792b804e" status: 404 len: 111 microversion: 2.1 time: 0.142637 Jul 15 20:38:30.221729 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 108/214] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:30 2022] GET /compute/v2.1/servers/3839ab3a-cad8-488a-bbed-4f7c792b804e => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 20:38:30.459368 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-c88bcf52-bb5f-4ae1-9cbf-7d0860f806a8 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145cee1016d349ceb93323a170bc957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f9e0f8edb42848965b3c6141e88d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:30.469860 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-c88bcf52-bb5f-4ae1-9cbf-7d0860f806a8 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] 10.222.0.66 "GET /compute/v2.1/servers/0d0462a7-7852-48bd-80ae-c0f1a5a93dfc" status: 200 len: 1318 microversion: 2.1 time: 0.521085 Jul 15 20:38:30.470517 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 107/215] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:29 2022] GET /compute/v2.1/servers/0d0462a7-7852-48bd-80ae-c0f1a5a93dfc => generated 1318 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:30.498090 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-f6098fe5-3607-42b3-8d86-2a4c32601b4c tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-120910621", "imageRef": "a759604a-67e3-4c79-b848-5d03d936d7a0", "flavorRef": "452", "networks": [{"uuid": "3de5205b-9819-41c2-a77d-3a58579765e3"}]}} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:38:30.577607 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.network.neutron [None req-f6098fe5-3607-42b3-8d86-2a4c32601b4c tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] validate_networks() for [('3de5205b-9819-41c2-a77d-3a58579765e3', None, None, None, None, None)] {{(pid=124430) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 20:38:30.627281 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-36046e75-ca85-4a90-b8f4-8efba3fbff02 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:30.628011 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-36046e75-ca85-4a90-b8f4-8efba3fbff02 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:30.638057 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-36046e75-ca85-4a90-b8f4-8efba3fbff02 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:30.638733 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-36046e75-ca85-4a90-b8f4-8efba3fbff02 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:30.639716 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-36046e75-ca85-4a90-b8f4-8efba3fbff02 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:30.645046 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-36046e75-ca85-4a90-b8f4-8efba3fbff02 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:31.576250 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-36046e75-ca85-4a90-b8f4-8efba3fbff02 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:31.594224 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-36046e75-ca85-4a90-b8f4-8efba3fbff02 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc" status: 200 len: 1522 microversion: 2.1 time: 0.970334 Jul 15 20:38:31.600921 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 108/216] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:30 2022] GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc => generated 1522 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:31.607551 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-7fa9ed3e-0689-4ab7-9844-04a0e7e0fdca req-5398ef29-1701-4e82-bd9f-2804fef6fde1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3839ab3a-cad8-488a-bbed-4f7c792b804e", "name": "network-vif-deleted", "tag": "c40927c0-fac9-4c62-9a5f-0099d8d055d7"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:38:31.658797 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-7fa9ed3e-0689-4ab7-9844-04a0e7e0fdca req-5398ef29-1701-4e82-bd9f-2804fef6fde1 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:31.661630 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-7fa9ed3e-0689-4ab7-9844-04a0e7e0fdca req-5398ef29-1701-4e82-bd9f-2804fef6fde1 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:31.689922 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-7fa9ed3e-0689-4ab7-9844-04a0e7e0fdca req-5398ef29-1701-4e82-bd9f-2804fef6fde1 service nova] Creating event network-vif-deleted:c40927c0-fac9-4c62-9a5f-0099d8d055d7 for instance 3839ab3a-cad8-488a-bbed-4f7c792b804e on hv-cinder-79987 Jul 15 20:38:31.710938 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-7fa9ed3e-0689-4ab7-9844-04a0e7e0fdca req-5398ef29-1701-4e82-bd9f-2804fef6fde1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094407 Jul 15 20:38:31.717273 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 109/217] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:38:31.727274 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-4da8141c-8377-49e5-b79f-a678cc3224df tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:31.731474 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-4da8141c-8377-49e5-b79f-a678cc3224df tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] [instance: 0d0462a7-7852-48bd-80ae-c0f1a5a93dfc] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:31.749219 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4da8141c-8377-49e5-b79f-a678cc3224df tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:31.751079 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4da8141c-8377-49e5-b79f-a678cc3224df tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:31.768847 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4da8141c-8377-49e5-b79f-a678cc3224df tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:31.774544 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4da8141c-8377-49e5-b79f-a678cc3224df tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:31.928455 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell0:SELECT=2 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:32.180192 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_cell0:SELECT=2 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:32.346499 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.virt.hardware [None req-f6098fe5-3607-42b3-8d86-2a4c32601b4c tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Flavor limits 0:0:0 {{(pid=124430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 20:38:32.346897 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.virt.hardware [None req-f6098fe5-3607-42b3-8d86-2a4c32601b4c tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Image limits 0:0:0 {{(pid=124430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 20:38:32.347925 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.virt.hardware [None req-f6098fe5-3607-42b3-8d86-2a4c32601b4c tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Flavor pref 0:0:0 {{(pid=124430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 20:38:32.348788 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.virt.hardware [None req-f6098fe5-3607-42b3-8d86-2a4c32601b4c tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Image pref 0:0:0 {{(pid=124430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 20:38:32.349420 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.virt.hardware [None req-f6098fe5-3607-42b3-8d86-2a4c32601b4c tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 20:38:32.354102 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-4da8141c-8377-49e5-b79f-a678cc3224df tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145cee1016d349ceb93323a170bc957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f9e0f8edb42848965b3c6141e88d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:32.366493 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-4da8141c-8377-49e5-b79f-a678cc3224df tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] 10.222.0.66 "GET /compute/v2.1/servers/0d0462a7-7852-48bd-80ae-c0f1a5a93dfc" status: 200 len: 1318 microversion: 2.1 time: 0.647662 Jul 15 20:38:32.367822 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 110/218] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:31 2022] GET /compute/v2.1/servers/0d0462a7-7852-48bd-80ae-c0f1a5a93dfc => generated 1318 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:32.381416 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-f6098fe5-3607-42b3-8d86-2a4c32601b4c tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:32.381885 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-f6098fe5-3607-42b3-8d86-2a4c32601b4c tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:32.382720 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-f6098fe5-3607-42b3-8d86-2a4c32601b4c tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:32.383165 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-f6098fe5-3607-42b3-8d86-2a4c32601b4c tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:32.435133 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.quota [None req-f6098fe5-3607-42b3-8d86-2a4c32601b4c tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Getting quotas for project 3129a35d484445db9e141028b2e77497. Resources: {'instances', 'ram', 'cores'} {{(pid=124430) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 20:38:32.440857 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.quota [None req-f6098fe5-3607-42b3-8d86-2a4c32601b4c tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Getting quotas for user 932ad1f03da24593a6ad444f6cb95e6d and project 3129a35d484445db9e141028b2e77497. Resources: {'instances', 'ram', 'cores'} {{(pid=124430) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 20:38:32.465988 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-f6098fe5-3607-42b3-8d86-2a4c32601b4c tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Going to run 1 instances... {{(pid=124430) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 20:38:32.473726 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-f6098fe5-3607-42b3-8d86-2a4c32601b4c tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] [instance: a0bae03b-5d67-44ea-80b7-bbb60da1a301] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a759604a-67e3-4c79-b848-5d03d936d7a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124430) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 20:38:32.589463 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-f6098fe5-3607-42b3-8d86-2a4c32601b4c tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.096905 Jul 15 20:38:32.596731 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 109/219] 10.222.0.66 () {60 vars in 1146 bytes} [Fri Jul 15 20:38:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 2105 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 20:38:32.602191 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-ef668281-598b-487b-93da-cbcd45c53609 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:32.603094 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-ef668281-598b-487b-93da-cbcd45c53609 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] [instance: a0bae03b-5d67-44ea-80b7-bbb60da1a301] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:32.623409 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-de4963c3-13f3-41fd-8402-555bed73135d tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:32.624033 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-de4963c3-13f3-41fd-8402-555bed73135d tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:32.633000 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-de4963c3-13f3-41fd-8402-555bed73135d tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:32.634160 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-de4963c3-13f3-41fd-8402-555bed73135d tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:32.635440 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-de4963c3-13f3-41fd-8402-555bed73135d tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:32.636145 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-de4963c3-13f3-41fd-8402-555bed73135d tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:32.919834 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-ef668281-598b-487b-93da-cbcd45c53609 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932ad1f03da24593a6ad444f6cb95e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129a35d484445db9e141028b2e77497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:32.932184 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-ef668281-598b-487b-93da-cbcd45c53609 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] 10.222.0.66 "GET /compute/v2.1/servers/a0bae03b-5d67-44ea-80b7-bbb60da1a301" status: 200 len: 1213 microversion: 2.1 time: 0.333446 Jul 15 20:38:32.933030 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 111/220] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:32 2022] GET /compute/v2.1/servers/a0bae03b-5d67-44ea-80b7-bbb60da1a301 => generated 1213 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:38:33.148184 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-de4963c3-13f3-41fd-8402-555bed73135d tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:33.157235 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-de4963c3-13f3-41fd-8402-555bed73135d tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc" status: 200 len: 1522 microversion: 2.1 time: 0.542076 Jul 15 20:38:33.157750 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 110/221] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:32 2022] GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc => generated 1522 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:38:33.356822 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-605f54bf-004b-4b09-a830-d8862f5ca9da tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-790825018", "imageRef": "a759604a-67e3-4c79-b848-5d03d936d7a0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2ff4648d-db69-4beb-a549-03dce5a885bc"}], "security_groups": [{"name": "tempest-securitygroup--286511700"}], "key_name": "tempest-keypair-211388367", "user_data": "}} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:38:33.396955 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-7ca7b854-11df-4183-aa67-3565d006368a tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:33.399398 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-7ca7b854-11df-4183-aa67-3565d006368a tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] [instance: 0d0462a7-7852-48bd-80ae-c0f1a5a93dfc] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:33.445274 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-7ca7b854-11df-4183-aa67-3565d006368a tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:33.446654 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-7ca7b854-11df-4183-aa67-3565d006368a tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:33.447844 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-7ca7b854-11df-4183-aa67-3565d006368a tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:33.457462 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-7ca7b854-11df-4183-aa67-3565d006368a tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:33.495142 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:33.664613 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.network.neutron [None req-605f54bf-004b-4b09-a830-d8862f5ca9da tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] validate_networks() for [('2ff4648d-db69-4beb-a549-03dce5a885bc', None, None, None, None, None)] {{(pid=124432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 20:38:33.819760 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-7ca7b854-11df-4183-aa67-3565d006368a tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145cee1016d349ceb93323a170bc957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f9e0f8edb42848965b3c6141e88d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:33.831126 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-7ca7b854-11df-4183-aa67-3565d006368a tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] 10.222.0.66 "GET /compute/v2.1/servers/0d0462a7-7852-48bd-80ae-c0f1a5a93dfc" status: 200 len: 1318 microversion: 2.1 time: 0.450223 Jul 15 20:38:33.831701 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 111/222] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:33 2022] GET /compute/v2.1/servers/0d0462a7-7852-48bd-80ae-c0f1a5a93dfc => generated 1318 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:33.951574 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-8875db1b-401f-4a43-be5f-c55752788e51 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:33.952187 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-8875db1b-401f-4a43-be5f-c55752788e51 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] [instance: a0bae03b-5d67-44ea-80b7-bbb60da1a301] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:33.960635 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8875db1b-401f-4a43-be5f-c55752788e51 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:33.961336 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8875db1b-401f-4a43-be5f-c55752788e51 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:33.962367 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8875db1b-401f-4a43-be5f-c55752788e51 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:33.963084 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8875db1b-401f-4a43-be5f-c55752788e51 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:34.048062 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-8875db1b-401f-4a43-be5f-c55752788e51 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932ad1f03da24593a6ad444f6cb95e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129a35d484445db9e141028b2e77497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:34.058332 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-8875db1b-401f-4a43-be5f-c55752788e51 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] 10.222.0.66 "GET /compute/v2.1/servers/a0bae03b-5d67-44ea-80b7-bbb60da1a301" status: 200 len: 1209 microversion: 2.1 time: 0.110027 Jul 15 20:38:34.059463 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 112/223] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:33 2022] GET /compute/v2.1/servers/a0bae03b-5d67-44ea-80b7-bbb60da1a301 => generated 1209 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:34.176004 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-119f45a8-0dee-4220-a47e-174a91bfc5fa tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:34.176756 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-119f45a8-0dee-4220-a47e-174a91bfc5fa tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:34.191312 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-119f45a8-0dee-4220-a47e-174a91bfc5fa tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:34.191749 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-119f45a8-0dee-4220-a47e-174a91bfc5fa tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:34.192568 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-119f45a8-0dee-4220-a47e-174a91bfc5fa tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:34.196612 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-119f45a8-0dee-4220-a47e-174a91bfc5fa tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:34.417478 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-605f54bf-004b-4b09-a830-d8862f5ca9da tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Flavor limits 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 20:38:34.418491 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-605f54bf-004b-4b09-a830-d8862f5ca9da tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Image limits 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 20:38:34.419357 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-605f54bf-004b-4b09-a830-d8862f5ca9da tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Flavor pref 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 20:38:34.420238 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-605f54bf-004b-4b09-a830-d8862f5ca9da tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Image pref 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 20:38:34.420742 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-605f54bf-004b-4b09-a830-d8862f5ca9da tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 20:38:34.422950 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-119f45a8-0dee-4220-a47e-174a91bfc5fa tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:34.434237 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-605f54bf-004b-4b09-a830-d8862f5ca9da tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:34.434816 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-605f54bf-004b-4b09-a830-d8862f5ca9da tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:34.435898 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-605f54bf-004b-4b09-a830-d8862f5ca9da tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:34.436428 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-605f54bf-004b-4b09-a830-d8862f5ca9da tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:34.441488 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-119f45a8-0dee-4220-a47e-174a91bfc5fa tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc" status: 200 len: 1502 microversion: 2.1 time: 0.261507 Jul 15 20:38:34.454848 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 113/224] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:34 2022] GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc => generated 1502 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:34.461217 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-d127e024-b134-4b79-b13d-9722ea699b1d tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:34.462065 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-d127e024-b134-4b79-b13d-9722ea699b1d tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 48c34b54-0234-4763-a6c1-f73c3c075277] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:34.470419 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d127e024-b134-4b79-b13d-9722ea699b1d tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:34.471192 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d127e024-b134-4b79-b13d-9722ea699b1d tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:34.472038 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d127e024-b134-4b79-b13d-9722ea699b1d tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:34.472563 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d127e024-b134-4b79-b13d-9722ea699b1d tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:34.479026 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-605f54bf-004b-4b09-a830-d8862f5ca9da tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Getting quotas for project 9af209f962144de4ae7e3575a3890096. Resources: {'instances', 'ram', 'cores'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 20:38:34.484627 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-605f54bf-004b-4b09-a830-d8862f5ca9da tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Getting quotas for user 75d12a685d9b419fa3606b5f4d1309fe and project 9af209f962144de4ae7e3575a3890096. Resources: {'instances', 'ram', 'cores'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 20:38:34.505517 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-605f54bf-004b-4b09-a830-d8862f5ca9da tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Going to run 1 instances... {{(pid=124432) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 20:38:34.508633 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-605f54bf-004b-4b09-a830-d8862f5ca9da tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a759604a-67e3-4c79-b848-5d03d936d7a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 20:38:34.633649 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-605f54bf-004b-4b09-a830-d8862f5ca9da tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.282961 Jul 15 20:38:34.643276 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 112/225] 10.222.0.66 () {60 vars in 1146 bytes} [Fri Jul 15 20:38:33 2022] POST /compute/v2.1/servers => generated 401 bytes in 1293 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 20:38:34.658849 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-52d1b645-c2e3-436e-9990-44ef433df561 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:34.661009 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-52d1b645-c2e3-436e-9990-44ef433df561 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: f45998cc-d9ed-4dd5-acf0-caba5d56696d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:34.683618 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-52d1b645-c2e3-436e-9990-44ef433df561 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:34.684703 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-52d1b645-c2e3-436e-9990-44ef433df561 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:34.685658 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-52d1b645-c2e3-436e-9990-44ef433df561 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:34.687865 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-52d1b645-c2e3-436e-9990-44ef433df561 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:34.762934 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-d127e024-b134-4b79-b13d-9722ea699b1d tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:34.763156 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-52d1b645-c2e3-436e-9990-44ef433df561 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d/ips" status: 200 len: 149 microversion: 2.1 time: 0.116402 Jul 15 20:38:34.766248 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 113/226] 10.222.0.66 () {58 vars in 1247 bytes} [Fri Jul 15 20:38:34 2022] GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d/ips => generated 149 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:38:34.778723 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-d127e024-b134-4b79-b13d-9722ea699b1d tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277" status: 200 len: 1516 microversion: 2.1 time: 0.319836 Jul 15 20:38:34.780206 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 114/227] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:34 2022] GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277 => generated 1516 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:34.780443 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-c5ad791d-44c2-42b8-bbf5-ffa18df5b186 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:34.781895 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-c5ad791d-44c2-42b8-bbf5-ffa18df5b186 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:34.852550 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-6cce4193-7785-433b-8dce-740018b87eb3 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:34.854701 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-6cce4193-7785-433b-8dce-740018b87eb3 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] [instance: 0d0462a7-7852-48bd-80ae-c0f1a5a93dfc] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:34.869315 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-6cce4193-7785-433b-8dce-740018b87eb3 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:34.873088 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-6cce4193-7785-433b-8dce-740018b87eb3 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:34.876262 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-6cce4193-7785-433b-8dce-740018b87eb3 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:34.877008 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-6cce4193-7785-433b-8dce-740018b87eb3 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:34.949347 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-c5ad791d-44c2-42b8-bbf5-ffa18df5b186 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d12a685d9b419fa3606b5f4d1309fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af209f962144de4ae7e3575a3890096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:34.962935 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-c5ad791d-44c2-42b8-bbf5-ffa18df5b186 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e" status: 200 len: 1236 microversion: 2.1 time: 0.195178 Jul 15 20:38:34.968294 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 114/228] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:34 2022] GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e => generated 1236 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:34.985894 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-004c31cf-943f-44f8-b053-915bf31af6cb req-65ee8c7f-ada4-433f-b1b1-d894c455c5c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d0462a7-7852-48bd-80ae-c0f1a5a93dfc", "name": "network-vif-plugged", "status": "completed", "tag": "b9a5bff9-00b3-434f-b108-d1df2ac35acd"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:38:35.018948 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-004c31cf-943f-44f8-b053-915bf31af6cb req-65ee8c7f-ada4-433f-b1b1-d894c455c5c7 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:35.023111 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-004c31cf-943f-44f8-b053-915bf31af6cb req-65ee8c7f-ada4-433f-b1b1-d894c455c5c7 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:35.054939 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-004c31cf-943f-44f8-b053-915bf31af6cb req-65ee8c7f-ada4-433f-b1b1-d894c455c5c7 service nova] Creating event network-vif-plugged:b9a5bff9-00b3-434f-b108-d1df2ac35acd for instance 0d0462a7-7852-48bd-80ae-c0f1a5a93dfc on hv-cinder-79987 Jul 15 20:38:35.068367 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-004c31cf-943f-44f8-b053-915bf31af6cb req-65ee8c7f-ada4-433f-b1b1-d894c455c5c7 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091505 Jul 15 20:38:35.084899 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 115/229] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:38:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:38:35.102373 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-0c7c7fb0-ed81-4942-8b79-5ff1b74f4302 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:35.111397 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-0c7c7fb0-ed81-4942-8b79-5ff1b74f4302 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] [instance: a0bae03b-5d67-44ea-80b7-bbb60da1a301] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:35.139986 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0c7c7fb0-ed81-4942-8b79-5ff1b74f4302 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:35.143966 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0c7c7fb0-ed81-4942-8b79-5ff1b74f4302 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:35.145343 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0c7c7fb0-ed81-4942-8b79-5ff1b74f4302 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:35.147156 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0c7c7fb0-ed81-4942-8b79-5ff1b74f4302 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:35.200290 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-6cce4193-7785-433b-8dce-740018b87eb3 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145cee1016d349ceb93323a170bc957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f9e0f8edb42848965b3c6141e88d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:35.214756 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-6cce4193-7785-433b-8dce-740018b87eb3 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] 10.222.0.66 "GET /compute/v2.1/servers/0d0462a7-7852-48bd-80ae-c0f1a5a93dfc" status: 200 len: 1318 microversion: 2.1 time: 0.367744 Jul 15 20:38:35.216978 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 115/230] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:34 2022] GET /compute/v2.1/servers/0d0462a7-7852-48bd-80ae-c0f1a5a93dfc => generated 1318 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:35.334511 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-0c7c7fb0-ed81-4942-8b79-5ff1b74f4302 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932ad1f03da24593a6ad444f6cb95e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129a35d484445db9e141028b2e77497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:35.346307 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-0c7c7fb0-ed81-4942-8b79-5ff1b74f4302 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] 10.222.0.66 "GET /compute/v2.1/servers/a0bae03b-5d67-44ea-80b7-bbb60da1a301" status: 200 len: 1271 microversion: 2.1 time: 0.259204 Jul 15 20:38:35.347381 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 116/231] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:35 2022] GET /compute/v2.1/servers/a0bae03b-5d67-44ea-80b7-bbb60da1a301 => generated 1271 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:35.985852 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-8fb27c21-b594-4a8d-8300-0e785f5e25eb tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:35.986454 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-8fb27c21-b594-4a8d-8300-0e785f5e25eb tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:36.002135 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8fb27c21-b594-4a8d-8300-0e785f5e25eb tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:36.004906 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8fb27c21-b594-4a8d-8300-0e785f5e25eb tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:36.005758 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8fb27c21-b594-4a8d-8300-0e785f5e25eb tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:36.006199 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8fb27c21-b594-4a8d-8300-0e785f5e25eb tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:36.115466 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-8fb27c21-b594-4a8d-8300-0e785f5e25eb tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d12a685d9b419fa3606b5f4d1309fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af209f962144de4ae7e3575a3890096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:36.123107 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-8fb27c21-b594-4a8d-8300-0e785f5e25eb tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e" status: 200 len: 1232 microversion: 2.1 time: 0.142316 Jul 15 20:38:36.123773 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 116/232] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:35 2022] GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e => generated 1232 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:36.234307 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-d50969a0-b2c6-4fc3-b756-82ed2cf5d2dc tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:36.235946 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-d50969a0-b2c6-4fc3-b756-82ed2cf5d2dc tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] [instance: 0d0462a7-7852-48bd-80ae-c0f1a5a93dfc] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:36.242853 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d50969a0-b2c6-4fc3-b756-82ed2cf5d2dc tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:36.243314 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d50969a0-b2c6-4fc3-b756-82ed2cf5d2dc tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:36.244064 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d50969a0-b2c6-4fc3-b756-82ed2cf5d2dc tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:36.244843 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d50969a0-b2c6-4fc3-b756-82ed2cf5d2dc tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:36.373153 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-e35eac2a-b7a7-4c36-9030-15847c9d18fc tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:36.376539 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-e35eac2a-b7a7-4c36-9030-15847c9d18fc tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] [instance: a0bae03b-5d67-44ea-80b7-bbb60da1a301] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:36.395578 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e35eac2a-b7a7-4c36-9030-15847c9d18fc tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:36.395578 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e35eac2a-b7a7-4c36-9030-15847c9d18fc tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:36.398563 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e35eac2a-b7a7-4c36-9030-15847c9d18fc tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:36.399129 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e35eac2a-b7a7-4c36-9030-15847c9d18fc tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:36.464175 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-d50969a0-b2c6-4fc3-b756-82ed2cf5d2dc tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145cee1016d349ceb93323a170bc957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f9e0f8edb42848965b3c6141e88d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:36.474764 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-d50969a0-b2c6-4fc3-b756-82ed2cf5d2dc tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] 10.222.0.66 "GET /compute/v2.1/servers/0d0462a7-7852-48bd-80ae-c0f1a5a93dfc" status: 200 len: 1318 microversion: 2.1 time: 0.244557 Jul 15 20:38:36.476120 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 117/233] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:36 2022] GET /compute/v2.1/servers/0d0462a7-7852-48bd-80ae-c0f1a5a93dfc => generated 1318 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:36.609483 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-c3a5a67a-75b2-40db-ac84-d45b8a0442d5 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "954cc00f-a264-43df-93b2-ab7f5020d9fa"}} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:38:36.611136 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-c3a5a67a-75b2-40db-ac84-d45b8a0442d5 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: f45998cc-d9ed-4dd5-acf0-caba5d56696d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:36.620703 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c3a5a67a-75b2-40db-ac84-d45b8a0442d5 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:36.624279 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c3a5a67a-75b2-40db-ac84-d45b8a0442d5 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:36.626357 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c3a5a67a-75b2-40db-ac84-d45b8a0442d5 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:36.628202 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c3a5a67a-75b2-40db-ac84-d45b8a0442d5 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:36.647943 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-e35eac2a-b7a7-4c36-9030-15847c9d18fc tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932ad1f03da24593a6ad444f6cb95e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129a35d484445db9e141028b2e77497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:36.653053 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell1:SELECT=100 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:36.663011 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-e35eac2a-b7a7-4c36-9030-15847c9d18fc tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] 10.222.0.66 "GET /compute/v2.1/servers/a0bae03b-5d67-44ea-80b7-bbb60da1a301" status: 200 len: 1313 microversion: 2.1 time: 0.300886 Jul 15 20:38:36.665987 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 117/234] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:36 2022] GET /compute/v2.1/servers/a0bae03b-5d67-44ea-80b7-bbb60da1a301 => generated 1313 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:36.809176 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-9f84ac70-d46c-49f3-8431-29da8eb502f1 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:38:36.822449 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-9f84ac70-d46c-49f3-8431-29da8eb502f1 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 48c34b54-0234-4763-a6c1-f73c3c075277] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:36.832491 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-9f84ac70-d46c-49f3-8431-29da8eb502f1 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:36.844806 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-9f84ac70-d46c-49f3-8431-29da8eb502f1 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:36.849689 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-9f84ac70-d46c-49f3-8431-29da8eb502f1 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:36.850369 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-9f84ac70-d46c-49f3-8431-29da8eb502f1 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:36.898520 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.objects.instance [None req-9f84ac70-d46c-49f3-8431-29da8eb502f1 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lazy-loading 'flavor' on Instance uuid 48c34b54-0234-4763-a6c1-f73c3c075277 {{(pid=124430) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 20:38:37.098339 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-9f84ac70-d46c-49f3-8431-29da8eb502f1 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "POST /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277/action" status: 200 len: 32 microversion: 2.1 time: 0.292486 Jul 15 20:38:37.098339 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 118/235] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 15 20:38:36 2022] POST /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277/action => generated 32 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 15 20:38:37.110386 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-5fafbbb4-35ce-4915-9bdd-bee63eb655d9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:37.111260 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-5fafbbb4-35ce-4915-9bdd-bee63eb655d9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 48c34b54-0234-4763-a6c1-f73c3c075277] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:37.117845 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-5fafbbb4-35ce-4915-9bdd-bee63eb655d9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:37.118349 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-5fafbbb4-35ce-4915-9bdd-bee63eb655d9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:37.119159 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-5fafbbb4-35ce-4915-9bdd-bee63eb655d9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:37.119696 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-5fafbbb4-35ce-4915-9bdd-bee63eb655d9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:37.387526 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-5fafbbb4-35ce-4915-9bdd-bee63eb655d9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:37.399741 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-5fafbbb4-35ce-4915-9bdd-bee63eb655d9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277" status: 200 len: 1522 microversion: 2.1 time: 0.294599 Jul 15 20:38:37.411267 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 119/236] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:37 2022] GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277 => generated 1522 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:38:37.418383 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-7dca8de6-1551-404c-9457-659ee40c6aab tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:37.419285 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-7dca8de6-1551-404c-9457-659ee40c6aab tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:37.428081 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-7dca8de6-1551-404c-9457-659ee40c6aab tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:37.429024 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-7dca8de6-1551-404c-9457-659ee40c6aab tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:37.430033 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-7dca8de6-1551-404c-9457-659ee40c6aab tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:37.430626 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-7dca8de6-1551-404c-9457-659ee40c6aab tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:37.575667 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-7dca8de6-1551-404c-9457-659ee40c6aab tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d12a685d9b419fa3606b5f4d1309fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af209f962144de4ae7e3575a3890096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:37.586176 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-7dca8de6-1551-404c-9457-659ee40c6aab tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e" status: 200 len: 1296 microversion: 2.1 time: 0.173467 Jul 15 20:38:37.586888 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 120/237] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:37 2022] GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e => generated 1296 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:37.591425 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [req-43e06c70-9906-4ce9-aae8-c14e677305c5 req-001a5aa3-cd4c-4286-b858-6f7c9766ae00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0bae03b-5d67-44ea-80b7-bbb60da1a301", "tag": "b6b490da-bbb4-4902-93a5-74ee3c23b2b2"}]} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:38:37.614227 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-43e06c70-9906-4ce9-aae8-c14e677305c5 req-001a5aa3-cd4c-4286-b858-6f7c9766ae00 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:37.615112 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-43e06c70-9906-4ce9-aae8-c14e677305c5 req-001a5aa3-cd4c-4286-b858-6f7c9766ae00 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:37.641869 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.compute.server_external_events [req-43e06c70-9906-4ce9-aae8-c14e677305c5 req-001a5aa3-cd4c-4286-b858-6f7c9766ae00 service nova] Creating event network-changed:b6b490da-bbb4-4902-93a5-74ee3c23b2b2 for instance a0bae03b-5d67-44ea-80b7-bbb60da1a301 on hv-cinder-79987 Jul 15 20:38:37.652827 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [req-43e06c70-9906-4ce9-aae8-c14e677305c5 req-001a5aa3-cd4c-4286-b858-6f7c9766ae00 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064591 Jul 15 20:38:37.653072 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-c3a5a67a-75b2-40db-ac84-d45b8a0442d5 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "POST /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.049570 Jul 15 20:38:37.653514 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 121/238] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:38:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:38:37.653728 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 118/239] 10.222.0.66 () {60 vars in 1322 bytes} [Fri Jul 15 20:38:36 2022] POST /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d/os-volume_attachments => generated 194 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 20:38:37.663821 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-c0166d82-f13a-47c7-b0ff-0111fb463459 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:37.664941 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-c0166d82-f13a-47c7-b0ff-0111fb463459 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] [instance: 0d0462a7-7852-48bd-80ae-c0f1a5a93dfc] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:37.679437 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c0166d82-f13a-47c7-b0ff-0111fb463459 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:37.679884 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c0166d82-f13a-47c7-b0ff-0111fb463459 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:37.680676 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c0166d82-f13a-47c7-b0ff-0111fb463459 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:37.681108 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c0166d82-f13a-47c7-b0ff-0111fb463459 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:37.684001 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-82bde162-624a-479f-894f-8000b0499656 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:37.685006 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-82bde162-624a-479f-894f-8000b0499656 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] [instance: a0bae03b-5d67-44ea-80b7-bbb60da1a301] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:37.701999 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-82bde162-624a-479f-894f-8000b0499656 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:37.702451 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-82bde162-624a-479f-894f-8000b0499656 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:37.703376 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-82bde162-624a-479f-894f-8000b0499656 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:37.703821 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-82bde162-624a-479f-894f-8000b0499656 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:38.053609 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-82bde162-624a-479f-894f-8000b0499656 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932ad1f03da24593a6ad444f6cb95e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129a35d484445db9e141028b2e77497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:38.062583 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-82bde162-624a-479f-894f-8000b0499656 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] 10.222.0.66 "GET /compute/v2.1/servers/a0bae03b-5d67-44ea-80b7-bbb60da1a301" status: 200 len: 1313 microversion: 2.1 time: 0.382497 Jul 15 20:38:38.063436 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 119/240] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:37 2022] GET /compute/v2.1/servers/a0bae03b-5d67-44ea-80b7-bbb60da1a301 => generated 1313 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:38.095581 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-c0166d82-f13a-47c7-b0ff-0111fb463459 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145cee1016d349ceb93323a170bc957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f9e0f8edb42848965b3c6141e88d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:38.106804 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-c0166d82-f13a-47c7-b0ff-0111fb463459 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] 10.222.0.66 "GET /compute/v2.1/servers/0d0462a7-7852-48bd-80ae-c0f1a5a93dfc" status: 200 len: 1508 microversion: 2.1 time: 0.451799 Jul 15 20:38:38.108233 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 122/241] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:37 2022] GET /compute/v2.1/servers/0d0462a7-7852-48bd-80ae-c0f1a5a93dfc => generated 1508 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:38.419267 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-7e178868-342e-4596-908d-9bf8b6e9ef31 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:38.419883 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-7e178868-342e-4596-908d-9bf8b6e9ef31 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 48c34b54-0234-4763-a6c1-f73c3c075277] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:38.431817 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7e178868-342e-4596-908d-9bf8b6e9ef31 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:38.435343 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7e178868-342e-4596-908d-9bf8b6e9ef31 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:38.436341 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7e178868-342e-4596-908d-9bf8b6e9ef31 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:38.436911 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7e178868-342e-4596-908d-9bf8b6e9ef31 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:38.607150 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-72728de5-a49b-48c1-978e-416c033250f3 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:38.608742 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-72728de5-a49b-48c1-978e-416c033250f3 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:38.621627 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-72728de5-a49b-48c1-978e-416c033250f3 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:38.622891 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-72728de5-a49b-48c1-978e-416c033250f3 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:38.624135 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-72728de5-a49b-48c1-978e-416c033250f3 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:38.626115 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-72728de5-a49b-48c1-978e-416c033250f3 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:38.634302 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-7e178868-342e-4596-908d-9bf8b6e9ef31 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:38.642814 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-7e178868-342e-4596-908d-9bf8b6e9ef31 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277" status: 200 len: 1522 microversion: 2.1 time: 0.228658 Jul 15 20:38:38.643393 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 120/242] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:38 2022] GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277 => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:38:38.649766 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-946b9e2a-81b7-4de0-9a2f-2a04524a5f7e tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-733773562", "imageRef": "a759604a-67e3-4c79-b848-5d03d936d7a0", "flavorRef": "452"}} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:38:38.740686 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.network.neutron [None req-946b9e2a-81b7-4de0-9a2f-2a04524a5f7e tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] validate_networks() for None {{(pid=124432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 20:38:38.899873 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-72728de5-a49b-48c1-978e-416c033250f3 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d12a685d9b419fa3606b5f4d1309fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af209f962144de4ae7e3575a3890096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:38.908798 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-72728de5-a49b-48c1-978e-416c033250f3 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e" status: 200 len: 1361 microversion: 2.1 time: 0.306611 Jul 15 20:38:38.909893 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 123/243] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:38 2022] GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e => generated 1361 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:39.081747 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-8d9955ba-c9aa-49de-a71b-deabb892fb08 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:39.082590 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-8d9955ba-c9aa-49de-a71b-deabb892fb08 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] [instance: a0bae03b-5d67-44ea-80b7-bbb60da1a301] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:39.089853 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8d9955ba-c9aa-49de-a71b-deabb892fb08 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:39.090437 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8d9955ba-c9aa-49de-a71b-deabb892fb08 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:39.091480 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8d9955ba-c9aa-49de-a71b-deabb892fb08 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:39.092075 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8d9955ba-c9aa-49de-a71b-deabb892fb08 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:39.465744 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-8d9955ba-c9aa-49de-a71b-deabb892fb08 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932ad1f03da24593a6ad444f6cb95e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129a35d484445db9e141028b2e77497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:39.468005 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-946b9e2a-81b7-4de0-9a2f-2a04524a5f7e tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Flavor limits 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 20:38:39.468501 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-946b9e2a-81b7-4de0-9a2f-2a04524a5f7e tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Image limits 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 20:38:39.469224 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-946b9e2a-81b7-4de0-9a2f-2a04524a5f7e tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Flavor pref 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 20:38:39.470010 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-946b9e2a-81b7-4de0-9a2f-2a04524a5f7e tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Image pref 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 20:38:39.470783 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-946b9e2a-81b7-4de0-9a2f-2a04524a5f7e tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 20:38:39.476093 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-8d9955ba-c9aa-49de-a71b-deabb892fb08 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] 10.222.0.66 "GET /compute/v2.1/servers/a0bae03b-5d67-44ea-80b7-bbb60da1a301" status: 200 len: 1313 microversion: 2.1 time: 0.399926 Jul 15 20:38:39.485751 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 124/244] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:39 2022] GET /compute/v2.1/servers/a0bae03b-5d67-44ea-80b7-bbb60da1a301 => generated 1313 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:39.491856 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-946b9e2a-81b7-4de0-9a2f-2a04524a5f7e tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:39.492700 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-946b9e2a-81b7-4de0-9a2f-2a04524a5f7e tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:39.493584 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-946b9e2a-81b7-4de0-9a2f-2a04524a5f7e tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:39.494095 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-946b9e2a-81b7-4de0-9a2f-2a04524a5f7e tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:39.512550 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-946b9e2a-81b7-4de0-9a2f-2a04524a5f7e tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Getting quotas for project 5c6d9917fc484639a0e0793ae14496b2. Resources: {'instances', 'ram', 'cores'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 20:38:39.523634 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-946b9e2a-81b7-4de0-9a2f-2a04524a5f7e tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Getting quotas for user d204ddb1baba4bf497d25115cf76a83b and project 5c6d9917fc484639a0e0793ae14496b2. Resources: {'instances', 'ram', 'cores'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 20:38:39.540904 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-946b9e2a-81b7-4de0-9a2f-2a04524a5f7e tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Going to run 1 instances... {{(pid=124432) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 20:38:39.543878 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-946b9e2a-81b7-4de0-9a2f-2a04524a5f7e tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] [instance: 17705da4-6daf-4403-9461-348f62b9838b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a759604a-67e3-4c79-b848-5d03d936d7a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 20:38:39.599345 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-946b9e2a-81b7-4de0-9a2f-2a04524a5f7e tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.954866 Jul 15 20:38:39.599995 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 121/245] 10.222.0.66 () {60 vars in 1146 bytes} [Fri Jul 15 20:38:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 956 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 20:38:39.611298 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-62b215ff-2b1a-43e0-8467-bc9e9280c2f5 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:39.612261 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-62b215ff-2b1a-43e0-8467-bc9e9280c2f5 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] [instance: 17705da4-6daf-4403-9461-348f62b9838b] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:39.674848 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-4b51ad94-564c-48d0-b664-39ddabfeffba tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:39.676129 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-4b51ad94-564c-48d0-b664-39ddabfeffba tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 48c34b54-0234-4763-a6c1-f73c3c075277] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:39.689173 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4b51ad94-564c-48d0-b664-39ddabfeffba tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:39.689674 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4b51ad94-564c-48d0-b664-39ddabfeffba tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:39.690844 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4b51ad94-564c-48d0-b664-39ddabfeffba tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:39.695084 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4b51ad94-564c-48d0-b664-39ddabfeffba tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:39.719219 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-62b215ff-2b1a-43e0-8467-bc9e9280c2f5 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd204ddb1baba4bf497d25115cf76a83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6d9917fc484639a0e0793ae14496b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:39.727485 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-62b215ff-2b1a-43e0-8467-bc9e9280c2f5 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] 10.222.0.66 "GET /compute/v2.1/servers/17705da4-6daf-4403-9461-348f62b9838b" status: 200 len: 1214 microversion: 2.1 time: 0.120642 Jul 15 20:38:39.733027 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 125/246] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:39 2022] GET /compute/v2.1/servers/17705da4-6daf-4403-9461-348f62b9838b => generated 1214 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:39.928844 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-a34e446d-5c04-42d4-a616-d230b86640a0 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:39.929456 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-a34e446d-5c04-42d4-a616-d230b86640a0 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:39.951679 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-a34e446d-5c04-42d4-a616-d230b86640a0 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:39.953428 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-a34e446d-5c04-42d4-a616-d230b86640a0 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:39.954565 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-a34e446d-5c04-42d4-a616-d230b86640a0 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:39.958495 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-a34e446d-5c04-42d4-a616-d230b86640a0 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:39.984860 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-4b51ad94-564c-48d0-b664-39ddabfeffba tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:40.002058 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-4b51ad94-564c-48d0-b664-39ddabfeffba tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277" status: 200 len: 1522 microversion: 2.1 time: 0.346112 Jul 15 20:38:40.015331 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 122/247] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:39 2022] GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277 => generated 1522 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:40.206447 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-ac549885-000e-4a15-bb00-162777c79bf8 req-8f04e5cd-cbfe-4736-8a84-622ede8f2e39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e", "tag": "a159b185-0579-4cd7-b4de-9e9d9f79f9a8"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:38:40.222323 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-ac549885-000e-4a15-bb00-162777c79bf8 req-8f04e5cd-cbfe-4736-8a84-622ede8f2e39 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:40.223071 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-ac549885-000e-4a15-bb00-162777c79bf8 req-8f04e5cd-cbfe-4736-8a84-622ede8f2e39 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:40.257312 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-ac549885-000e-4a15-bb00-162777c79bf8 req-8f04e5cd-cbfe-4736-8a84-622ede8f2e39 service nova] Creating event network-changed:a159b185-0579-4cd7-b4de-9e9d9f79f9a8 for instance 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e on hv-cinder-79987 Jul 15 20:38:40.265755 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-ac549885-000e-4a15-bb00-162777c79bf8 req-8f04e5cd-cbfe-4736-8a84-622ede8f2e39 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063075 Jul 15 20:38:40.267403 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 123/248] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:38:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:38:40.272921 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-a34e446d-5c04-42d4-a616-d230b86640a0 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d12a685d9b419fa3606b5f4d1309fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af209f962144de4ae7e3575a3890096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:40.282104 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-a34e446d-5c04-42d4-a616-d230b86640a0 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e" status: 200 len: 1361 microversion: 2.1 time: 0.359128 Jul 15 20:38:40.282742 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 126/249] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:39 2022] GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e => generated 1361 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:40.497146 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-57fbbd1a-a5c6-494e-92f5-e3415ce5ba3d tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:40.497944 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-57fbbd1a-a5c6-494e-92f5-e3415ce5ba3d tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] [instance: a0bae03b-5d67-44ea-80b7-bbb60da1a301] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:40.505651 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-57fbbd1a-a5c6-494e-92f5-e3415ce5ba3d tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:40.506097 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-57fbbd1a-a5c6-494e-92f5-e3415ce5ba3d tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:40.506865 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-57fbbd1a-a5c6-494e-92f5-e3415ce5ba3d tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:40.507299 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-57fbbd1a-a5c6-494e-92f5-e3415ce5ba3d tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:40.646452 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-57fbbd1a-a5c6-494e-92f5-e3415ce5ba3d tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932ad1f03da24593a6ad444f6cb95e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129a35d484445db9e141028b2e77497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:40.654101 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-57fbbd1a-a5c6-494e-92f5-e3415ce5ba3d tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] 10.222.0.66 "GET /compute/v2.1/servers/a0bae03b-5d67-44ea-80b7-bbb60da1a301" status: 200 len: 1313 microversion: 2.1 time: 0.163831 Jul 15 20:38:40.654682 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 124/250] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:40 2022] GET /compute/v2.1/servers/a0bae03b-5d67-44ea-80b7-bbb60da1a301 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:40.747155 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-c6908486-e073-402c-993e-6c38a788ed0b tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:40.747694 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-c6908486-e073-402c-993e-6c38a788ed0b tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] [instance: 17705da4-6daf-4403-9461-348f62b9838b] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:40.754460 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c6908486-e073-402c-993e-6c38a788ed0b tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:40.755033 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c6908486-e073-402c-993e-6c38a788ed0b tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:40.755813 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c6908486-e073-402c-993e-6c38a788ed0b tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:40.756258 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c6908486-e073-402c-993e-6c38a788ed0b tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:40.820925 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-c6908486-e073-402c-993e-6c38a788ed0b tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd204ddb1baba4bf497d25115cf76a83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6d9917fc484639a0e0793ae14496b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:40.824445 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:40.829502 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-c6908486-e073-402c-993e-6c38a788ed0b tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] 10.222.0.66 "GET /compute/v2.1/servers/17705da4-6daf-4403-9461-348f62b9838b" status: 200 len: 1218 microversion: 2.1 time: 0.086370 Jul 15 20:38:40.830062 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 127/251] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:40 2022] GET /compute/v2.1/servers/17705da4-6daf-4403-9461-348f62b9838b => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:41.020377 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-daffb832-a117-412f-a1ae-cf49361b7fca tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:41.021620 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-daffb832-a117-412f-a1ae-cf49361b7fca tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 48c34b54-0234-4763-a6c1-f73c3c075277] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:41.029313 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-daffb832-a117-412f-a1ae-cf49361b7fca tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:41.029820 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-daffb832-a117-412f-a1ae-cf49361b7fca tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:41.031412 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-daffb832-a117-412f-a1ae-cf49361b7fca tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:41.032067 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-daffb832-a117-412f-a1ae-cf49361b7fca tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:41.175906 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-daffb832-a117-412f-a1ae-cf49361b7fca tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:41.183496 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-daffb832-a117-412f-a1ae-cf49361b7fca tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277" status: 200 len: 1522 microversion: 2.1 time: 0.167305 Jul 15 20:38:41.184068 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 125/252] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:41 2022] GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:41.298515 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-982cb97a-66cd-4d10-942e-020d3e0201df tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:41.299027 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-982cb97a-66cd-4d10-942e-020d3e0201df tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:41.307361 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-982cb97a-66cd-4d10-942e-020d3e0201df tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:41.307870 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-982cb97a-66cd-4d10-942e-020d3e0201df tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:41.308666 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-982cb97a-66cd-4d10-942e-020d3e0201df tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:41.309163 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-982cb97a-66cd-4d10-942e-020d3e0201df tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:41.440774 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-982cb97a-66cd-4d10-942e-020d3e0201df tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d12a685d9b419fa3606b5f4d1309fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af209f962144de4ae7e3575a3890096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:41.449442 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-982cb97a-66cd-4d10-942e-020d3e0201df tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e" status: 200 len: 1361 microversion: 2.1 time: 0.154876 Jul 15 20:38:41.450020 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 128/253] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:41 2022] GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:41.671463 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-adb99155-bd7a-462e-a7c6-1221e16147b2 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:41.672367 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-adb99155-bd7a-462e-a7c6-1221e16147b2 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] [instance: a0bae03b-5d67-44ea-80b7-bbb60da1a301] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:41.674884 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:41.681236 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-adb99155-bd7a-462e-a7c6-1221e16147b2 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:41.681680 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-adb99155-bd7a-462e-a7c6-1221e16147b2 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:41.682457 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-adb99155-bd7a-462e-a7c6-1221e16147b2 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:41.682890 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-adb99155-bd7a-462e-a7c6-1221e16147b2 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:41.814670 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-adb99155-bd7a-462e-a7c6-1221e16147b2 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932ad1f03da24593a6ad444f6cb95e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129a35d484445db9e141028b2e77497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:41.822844 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-adb99155-bd7a-462e-a7c6-1221e16147b2 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] 10.222.0.66 "GET /compute/v2.1/servers/a0bae03b-5d67-44ea-80b7-bbb60da1a301" status: 200 len: 1313 microversion: 2.1 time: 0.155311 Jul 15 20:38:41.823503 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 126/254] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:41 2022] GET /compute/v2.1/servers/a0bae03b-5d67-44ea-80b7-bbb60da1a301 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:41.846392 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-af259206-316e-4054-b2ad-9dba1261882e tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:41.847083 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-af259206-316e-4054-b2ad-9dba1261882e tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] [instance: 17705da4-6daf-4403-9461-348f62b9838b] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:41.853443 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-af259206-316e-4054-b2ad-9dba1261882e tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:41.853995 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-af259206-316e-4054-b2ad-9dba1261882e tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:41.854773 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-af259206-316e-4054-b2ad-9dba1261882e tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:41.855200 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-af259206-316e-4054-b2ad-9dba1261882e tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:41.921760 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-af259206-316e-4054-b2ad-9dba1261882e tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd204ddb1baba4bf497d25115cf76a83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6d9917fc484639a0e0793ae14496b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:41.930088 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-af259206-316e-4054-b2ad-9dba1261882e tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] 10.222.0.66 "GET /compute/v2.1/servers/17705da4-6daf-4403-9461-348f62b9838b" status: 200 len: 1218 microversion: 2.1 time: 0.087579 Jul 15 20:38:41.930664 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 129/255] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:41 2022] GET /compute/v2.1/servers/17705da4-6daf-4403-9461-348f62b9838b => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:42.200630 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-de10687c-cc80-43bd-aad9-39c5f41bb3e2 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:42.201142 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-de10687c-cc80-43bd-aad9-39c5f41bb3e2 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 48c34b54-0234-4763-a6c1-f73c3c075277] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:42.207987 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-de10687c-cc80-43bd-aad9-39c5f41bb3e2 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:42.208724 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-de10687c-cc80-43bd-aad9-39c5f41bb3e2 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:42.209667 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-de10687c-cc80-43bd-aad9-39c5f41bb3e2 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:42.210607 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-de10687c-cc80-43bd-aad9-39c5f41bb3e2 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:42.354004 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-de10687c-cc80-43bd-aad9-39c5f41bb3e2 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:42.361813 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-de10687c-cc80-43bd-aad9-39c5f41bb3e2 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277" status: 200 len: 1522 microversion: 2.1 time: 0.165199 Jul 15 20:38:42.362406 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 127/256] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:42 2022] GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:42.466636 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-5e7af8ce-bee7-43e9-8e2f-b0aba2f65198 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:42.467241 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-5e7af8ce-bee7-43e9-8e2f-b0aba2f65198 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:42.469168 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_cell0:SELECT=2 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:42.474490 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-5e7af8ce-bee7-43e9-8e2f-b0aba2f65198 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:42.474938 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-5e7af8ce-bee7-43e9-8e2f-b0aba2f65198 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:42.475693 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-5e7af8ce-bee7-43e9-8e2f-b0aba2f65198 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:42.476124 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-5e7af8ce-bee7-43e9-8e2f-b0aba2f65198 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:42.607270 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-5e7af8ce-bee7-43e9-8e2f-b0aba2f65198 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d12a685d9b419fa3606b5f4d1309fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af209f962144de4ae7e3575a3890096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:42.615506 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-5e7af8ce-bee7-43e9-8e2f-b0aba2f65198 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e" status: 200 len: 1361 microversion: 2.1 time: 0.152633 Jul 15 20:38:42.616082 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 130/257] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:42 2022] GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:42.839581 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-a0a329d7-d2dc-4b2b-bbaf-d4ff76244269 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:42.840443 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-a0a329d7-d2dc-4b2b-bbaf-d4ff76244269 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] [instance: a0bae03b-5d67-44ea-80b7-bbb60da1a301] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:42.848209 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a0a329d7-d2dc-4b2b-bbaf-d4ff76244269 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:42.848777 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a0a329d7-d2dc-4b2b-bbaf-d4ff76244269 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:42.849599 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a0a329d7-d2dc-4b2b-bbaf-d4ff76244269 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:42.850065 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a0a329d7-d2dc-4b2b-bbaf-d4ff76244269 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:42.946857 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-81e3fc38-5f69-4a5e-abae-46dd89aa48e0 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:42.947582 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-81e3fc38-5f69-4a5e-abae-46dd89aa48e0 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] [instance: 17705da4-6daf-4403-9461-348f62b9838b] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:42.954823 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-81e3fc38-5f69-4a5e-abae-46dd89aa48e0 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:42.955268 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-81e3fc38-5f69-4a5e-abae-46dd89aa48e0 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:42.956026 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-81e3fc38-5f69-4a5e-abae-46dd89aa48e0 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:42.956545 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-81e3fc38-5f69-4a5e-abae-46dd89aa48e0 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:42.989704 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-a0a329d7-d2dc-4b2b-bbaf-d4ff76244269 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932ad1f03da24593a6ad444f6cb95e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129a35d484445db9e141028b2e77497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:43.014510 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-a0a329d7-d2dc-4b2b-bbaf-d4ff76244269 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] 10.222.0.66 "GET /compute/v2.1/servers/a0bae03b-5d67-44ea-80b7-bbb60da1a301" status: 200 len: 1313 microversion: 2.1 time: 0.178875 Jul 15 20:38:43.017941 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 128/258] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:42 2022] GET /compute/v2.1/servers/a0bae03b-5d67-44ea-80b7-bbb60da1a301 => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:43.057116 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-81e3fc38-5f69-4a5e-abae-46dd89aa48e0 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd204ddb1baba4bf497d25115cf76a83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6d9917fc484639a0e0793ae14496b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:43.067267 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-81e3fc38-5f69-4a5e-abae-46dd89aa48e0 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] 10.222.0.66 "GET /compute/v2.1/servers/17705da4-6daf-4403-9461-348f62b9838b" status: 200 len: 1218 microversion: 2.1 time: 0.124087 Jul 15 20:38:43.070174 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 131/259] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:42 2022] GET /compute/v2.1/servers/17705da4-6daf-4403-9461-348f62b9838b => generated 1218 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:38:43.379487 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-b6a84819-aca6-4378-b85a-35f75873387e tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:43.380203 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-b6a84819-aca6-4378-b85a-35f75873387e tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 48c34b54-0234-4763-a6c1-f73c3c075277] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:43.386769 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b6a84819-aca6-4378-b85a-35f75873387e tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:43.387230 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b6a84819-aca6-4378-b85a-35f75873387e tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:43.388001 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b6a84819-aca6-4378-b85a-35f75873387e tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:43.388458 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b6a84819-aca6-4378-b85a-35f75873387e tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:43.536230 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-b6a84819-aca6-4378-b85a-35f75873387e tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:43.544286 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-b6a84819-aca6-4378-b85a-35f75873387e tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277" status: 200 len: 1522 microversion: 2.1 time: 0.169476 Jul 15 20:38:43.556176 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 129/260] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:43 2022] GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:43.631845 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-74d9bb24-545d-4c51-855e-909d996c5e2d tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:43.632468 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-74d9bb24-545d-4c51-855e-909d996c5e2d tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:43.638647 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-74d9bb24-545d-4c51-855e-909d996c5e2d tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:43.639094 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-74d9bb24-545d-4c51-855e-909d996c5e2d tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:43.639861 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-74d9bb24-545d-4c51-855e-909d996c5e2d tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:43.640336 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-74d9bb24-545d-4c51-855e-909d996c5e2d tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:43.772782 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-74d9bb24-545d-4c51-855e-909d996c5e2d tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d12a685d9b419fa3606b5f4d1309fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af209f962144de4ae7e3575a3890096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:43.780099 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-74d9bb24-545d-4c51-855e-909d996c5e2d tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e" status: 200 len: 1361 microversion: 2.1 time: 0.152149 Jul 15 20:38:43.781446 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 132/261] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:43 2022] GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:44.034434 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-ff1b79f0-d3f0-44ef-b085-d4a4cf9b17e3 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:44.035042 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-ff1b79f0-d3f0-44ef-b085-d4a4cf9b17e3 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] [instance: a0bae03b-5d67-44ea-80b7-bbb60da1a301] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:44.041523 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ff1b79f0-d3f0-44ef-b085-d4a4cf9b17e3 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:44.042222 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ff1b79f0-d3f0-44ef-b085-d4a4cf9b17e3 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:44.042993 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ff1b79f0-d3f0-44ef-b085-d4a4cf9b17e3 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:44.043428 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ff1b79f0-d3f0-44ef-b085-d4a4cf9b17e3 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:44.090116 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-45e8db96-5586-46b3-bf3f-fcda5b786f8c tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:44.091373 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-45e8db96-5586-46b3-bf3f-fcda5b786f8c tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] [instance: 17705da4-6daf-4403-9461-348f62b9838b] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:44.103114 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-45e8db96-5586-46b3-bf3f-fcda5b786f8c tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:44.103576 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-45e8db96-5586-46b3-bf3f-fcda5b786f8c tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:44.105730 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-45e8db96-5586-46b3-bf3f-fcda5b786f8c tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:44.106388 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-45e8db96-5586-46b3-bf3f-fcda5b786f8c tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:44.229859 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-45e8db96-5586-46b3-bf3f-fcda5b786f8c tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd204ddb1baba4bf497d25115cf76a83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6d9917fc484639a0e0793ae14496b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:44.247204 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-45e8db96-5586-46b3-bf3f-fcda5b786f8c tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] 10.222.0.66 "GET /compute/v2.1/servers/17705da4-6daf-4403-9461-348f62b9838b" status: 200 len: 1266 microversion: 2.1 time: 0.164115 Jul 15 20:38:44.250862 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-ff1b79f0-d3f0-44ef-b085-d4a4cf9b17e3 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932ad1f03da24593a6ad444f6cb95e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129a35d484445db9e141028b2e77497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:44.253824 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 133/262] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:44 2022] GET /compute/v2.1/servers/17705da4-6daf-4403-9461-348f62b9838b => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:38:44.270456 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-ff1b79f0-d3f0-44ef-b085-d4a4cf9b17e3 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] 10.222.0.66 "GET /compute/v2.1/servers/a0bae03b-5d67-44ea-80b7-bbb60da1a301" status: 200 len: 1313 microversion: 2.1 time: 0.240770 Jul 15 20:38:44.271182 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 130/263] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:44 2022] GET /compute/v2.1/servers/a0bae03b-5d67-44ea-80b7-bbb60da1a301 => generated 1313 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:44.565932 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-ae0d2ca3-1781-4a39-a5cc-63da7c5ab36a tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:44.567297 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-ae0d2ca3-1781-4a39-a5cc-63da7c5ab36a tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 48c34b54-0234-4763-a6c1-f73c3c075277] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:44.579377 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-ae0d2ca3-1781-4a39-a5cc-63da7c5ab36a tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:44.580157 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-ae0d2ca3-1781-4a39-a5cc-63da7c5ab36a tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:44.581216 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-ae0d2ca3-1781-4a39-a5cc-63da7c5ab36a tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:44.581850 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-ae0d2ca3-1781-4a39-a5cc-63da7c5ab36a tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:44.630292 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-bcb09487-db56-4759-9ab2-dc415aa20f74 req-c9f9210b-ccf8-4221-9929-a199ccc96717 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0bae03b-5d67-44ea-80b7-bbb60da1a301", "name": "network-vif-plugged", "status": "completed", "tag": "b6b490da-bbb4-4902-93a5-74ee3c23b2b2"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:38:44.639158 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-bcb09487-db56-4759-9ab2-dc415aa20f74 req-c9f9210b-ccf8-4221-9929-a199ccc96717 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:44.640601 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-bcb09487-db56-4759-9ab2-dc415aa20f74 req-c9f9210b-ccf8-4221-9929-a199ccc96717 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:44.823384 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-bcb09487-db56-4759-9ab2-dc415aa20f74 req-c9f9210b-ccf8-4221-9929-a199ccc96717 service nova] Creating event network-vif-plugged:b6b490da-bbb4-4902-93a5-74ee3c23b2b2 for instance a0bae03b-5d67-44ea-80b7-bbb60da1a301 on hv-cinder-79987 Jul 15 20:38:44.829315 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-bcb09487-db56-4759-9ab2-dc415aa20f74 req-c9f9210b-ccf8-4221-9929-a199ccc96717 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.203821 Jul 15 20:38:44.830358 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 131/264] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:38:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 20:38:44.836093 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-02fd5e7b-a225-4a47-938d-a72ca0016100 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:44.836815 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-02fd5e7b-a225-4a47-938d-a72ca0016100 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:44.843579 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-02fd5e7b-a225-4a47-938d-a72ca0016100 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:44.844419 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-02fd5e7b-a225-4a47-938d-a72ca0016100 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:44.845393 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-02fd5e7b-a225-4a47-938d-a72ca0016100 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:44.845990 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-02fd5e7b-a225-4a47-938d-a72ca0016100 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:44.904905 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-ae0d2ca3-1781-4a39-a5cc-63da7c5ab36a tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:44.913221 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-ae0d2ca3-1781-4a39-a5cc-63da7c5ab36a tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277" status: 200 len: 1522 microversion: 2.1 time: 0.353587 Jul 15 20:38:44.923415 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 134/265] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:44 2022] GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277 => generated 1522 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:45.096290 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-02fd5e7b-a225-4a47-938d-a72ca0016100 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d12a685d9b419fa3606b5f4d1309fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af209f962144de4ae7e3575a3890096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:45.108886 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-02fd5e7b-a225-4a47-938d-a72ca0016100 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e" status: 200 len: 1361 microversion: 2.1 time: 0.276489 Jul 15 20:38:45.109726 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 132/266] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:44 2022] GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e => generated 1361 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:45.272894 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-208b3972-335b-4559-8ae0-2509c003f586 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:45.274163 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-208b3972-335b-4559-8ae0-2509c003f586 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] [instance: 17705da4-6daf-4403-9461-348f62b9838b] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:45.282339 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-208b3972-335b-4559-8ae0-2509c003f586 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:45.283155 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-208b3972-335b-4559-8ae0-2509c003f586 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:45.284285 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-208b3972-335b-4559-8ae0-2509c003f586 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:45.284958 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-208b3972-335b-4559-8ae0-2509c003f586 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:45.287783 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-5982c94c-09d7-4ca7-897c-37fb30713832 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:45.288412 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-5982c94c-09d7-4ca7-897c-37fb30713832 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] [instance: a0bae03b-5d67-44ea-80b7-bbb60da1a301] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:45.297444 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5982c94c-09d7-4ca7-897c-37fb30713832 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:45.297913 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5982c94c-09d7-4ca7-897c-37fb30713832 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:45.310213 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5982c94c-09d7-4ca7-897c-37fb30713832 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:45.310790 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5982c94c-09d7-4ca7-897c-37fb30713832 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:45.504165 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-208b3972-335b-4559-8ae0-2509c003f586 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd204ddb1baba4bf497d25115cf76a83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6d9917fc484639a0e0793ae14496b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:45.511766 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-208b3972-335b-4559-8ae0-2509c003f586 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] 10.222.0.66 "GET /compute/v2.1/servers/17705da4-6daf-4403-9461-348f62b9838b" status: 200 len: 1272 microversion: 2.1 time: 0.242777 Jul 15 20:38:45.512331 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 135/267] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:45 2022] GET /compute/v2.1/servers/17705da4-6daf-4403-9461-348f62b9838b => generated 1272 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:45.517574 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-27c7a7aa-a95e-4f45-a52c-34cd429da0d0 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Action: 'create', calling method: .version_select at 0x7ff5183d0ca0>, body: {"keypair": {"name": "tempest-keypair-138371225", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZTUD5MFy79vQ1K997sZIIeIGRHaFio8v9oYD6q0NujyAt7TZMfdpcAE3R3JwHfK/joGG+naO20qwlj0LWw1r0FL8r3ZcNV5Qjq5/sDgS5c5xxVi1qPSlZK07t+YaQREg=="}} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:38:45.532936 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.quota [None req-27c7a7aa-a95e-4f45-a52c-34cd429da0d0 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Getting quotas for project 78a593e163e74a7b9db61133e5c22035. Resources: {'key_pairs'} {{(pid=124430) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 20:38:45.538189 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.quota [None req-27c7a7aa-a95e-4f45-a52c-34cd429da0d0 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Getting quotas for user c0b5962b37b2470099436609425f7423 and project 78a593e163e74a7b9db61133e5c22035. Resources: {'key_pairs'} {{(pid=124430) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 20:38:45.554638 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:45.564934 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-27c7a7aa-a95e-4f45-a52c-34cd429da0d0 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.051350 Jul 15 20:38:45.566001 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 136/268] 10.222.0.66 () {60 vars in 1158 bytes} [Fri Jul 15 20:38:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:38:45.626824 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-5982c94c-09d7-4ca7-897c-37fb30713832 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932ad1f03da24593a6ad444f6cb95e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129a35d484445db9e141028b2e77497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:45.635729 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-5982c94c-09d7-4ca7-897c-37fb30713832 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] 10.222.0.66 "GET /compute/v2.1/servers/a0bae03b-5d67-44ea-80b7-bbb60da1a301" status: 200 len: 1313 microversion: 2.1 time: 0.352115 Jul 15 20:38:45.636669 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 133/269] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:45 2022] GET /compute/v2.1/servers/a0bae03b-5d67-44ea-80b7-bbb60da1a301 => generated 1313 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:45.931598 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-bb024484-f1ca-41bf-aa22-bf6772b875b6 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:45.932545 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-bb024484-f1ca-41bf-aa22-bf6772b875b6 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 48c34b54-0234-4763-a6c1-f73c3c075277] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:45.942709 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-bb024484-f1ca-41bf-aa22-bf6772b875b6 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:45.944575 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-bb024484-f1ca-41bf-aa22-bf6772b875b6 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:45.945636 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-bb024484-f1ca-41bf-aa22-bf6772b875b6 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:45.946709 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-bb024484-f1ca-41bf-aa22-bf6772b875b6 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:46.119973 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-bb024484-f1ca-41bf-aa22-bf6772b875b6 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:46.126398 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-10cc9c31-b215-4cec-9f7c-50351da3ef9e tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:46.127181 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-10cc9c31-b215-4cec-9f7c-50351da3ef9e tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:46.129934 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-bb024484-f1ca-41bf-aa22-bf6772b875b6 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277" status: 200 len: 1522 microversion: 2.1 time: 0.203547 Jul 15 20:38:46.140885 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 137/270] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:45 2022] GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:46.144057 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-10cc9c31-b215-4cec-9f7c-50351da3ef9e tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:46.144843 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-10cc9c31-b215-4cec-9f7c-50351da3ef9e tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:46.146021 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-10cc9c31-b215-4cec-9f7c-50351da3ef9e tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:46.146454 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-10cc9c31-b215-4cec-9f7c-50351da3ef9e tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:46.308278 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-10cc9c31-b215-4cec-9f7c-50351da3ef9e tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d12a685d9b419fa3606b5f4d1309fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af209f962144de4ae7e3575a3890096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:46.316806 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-10cc9c31-b215-4cec-9f7c-50351da3ef9e tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e" status: 200 len: 1361 microversion: 2.1 time: 0.194761 Jul 15 20:38:46.327929 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 134/271] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:46 2022] GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e => generated 1361 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:46.531001 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-a941f38f-83c0-42ef-a9cb-8a990fbaae74 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:46.532725 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-a941f38f-83c0-42ef-a9cb-8a990fbaae74 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] [instance: 17705da4-6daf-4403-9461-348f62b9838b] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:46.545265 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-a941f38f-83c0-42ef-a9cb-8a990fbaae74 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:46.545664 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-a941f38f-83c0-42ef-a9cb-8a990fbaae74 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:46.546504 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-a941f38f-83c0-42ef-a9cb-8a990fbaae74 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:46.546977 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-a941f38f-83c0-42ef-a9cb-8a990fbaae74 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:46.652791 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-41e5f96d-bb27-40ab-9b87-e03aae184c63 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:46.654181 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-41e5f96d-bb27-40ab-9b87-e03aae184c63 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] [instance: a0bae03b-5d67-44ea-80b7-bbb60da1a301] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:46.661831 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-41e5f96d-bb27-40ab-9b87-e03aae184c63 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:46.662489 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-41e5f96d-bb27-40ab-9b87-e03aae184c63 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:46.663268 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-41e5f96d-bb27-40ab-9b87-e03aae184c63 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:46.663793 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-41e5f96d-bb27-40ab-9b87-e03aae184c63 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:46.753839 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-a941f38f-83c0-42ef-a9cb-8a990fbaae74 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd204ddb1baba4bf497d25115cf76a83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6d9917fc484639a0e0793ae14496b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:46.762438 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-a941f38f-83c0-42ef-a9cb-8a990fbaae74 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] 10.222.0.66 "GET /compute/v2.1/servers/17705da4-6daf-4403-9461-348f62b9838b" status: 200 len: 1314 microversion: 2.1 time: 0.236356 Jul 15 20:38:46.763111 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 138/272] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:46 2022] GET /compute/v2.1/servers/17705da4-6daf-4403-9461-348f62b9838b => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:46.822840 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-41e5f96d-bb27-40ab-9b87-e03aae184c63 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932ad1f03da24593a6ad444f6cb95e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129a35d484445db9e141028b2e77497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:46.826617 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:46.831252 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-41e5f96d-bb27-40ab-9b87-e03aae184c63 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] 10.222.0.66 "GET /compute/v2.1/servers/a0bae03b-5d67-44ea-80b7-bbb60da1a301" status: 200 len: 1313 microversion: 2.1 time: 0.182263 Jul 15 20:38:46.831823 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 135/273] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:46 2022] GET /compute/v2.1/servers/a0bae03b-5d67-44ea-80b7-bbb60da1a301 => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:38:47.148771 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-ac82fd84-7fee-460d-b791-99ce3aaa7a47 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:47.149884 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-ac82fd84-7fee-460d-b791-99ce3aaa7a47 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 48c34b54-0234-4763-a6c1-f73c3c075277] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:47.162213 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-ac82fd84-7fee-460d-b791-99ce3aaa7a47 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:47.162994 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-ac82fd84-7fee-460d-b791-99ce3aaa7a47 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:47.163946 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-ac82fd84-7fee-460d-b791-99ce3aaa7a47 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:47.164560 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-ac82fd84-7fee-460d-b791-99ce3aaa7a47 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:47.309555 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-0db9a37d-fdc9-4142-9188-d20f40c4f00a tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1042323045", "imageRef": "a759604a-67e3-4c79-b848-5d03d936d7a0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f64ae9a9-bcaf-4115-89a7-71a9ec023719"}], "security_groups": [{"name": "tempest-securitygroup--1238112423"}], "key_name": "tempest-keypair-138371225", "user_data": "}} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:38:47.537679 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-ac82fd84-7fee-460d-b791-99ce3aaa7a47 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:47.559539 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-ac82fd84-7fee-460d-b791-99ce3aaa7a47 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277" status: 200 len: 1522 microversion: 2.1 time: 0.408121 Jul 15 20:38:47.570629 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.network.neutron [None req-0db9a37d-fdc9-4142-9188-d20f40c4f00a tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] validate_networks() for [('f64ae9a9-bcaf-4115-89a7-71a9ec023719', None, None, None, None, None)] {{(pid=124432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 20:38:47.573481 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 139/274] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:47 2022] GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277 => generated 1522 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:47.591437 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-b4fff530-a460-42d7-8565-ba61711fd428 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:47.592040 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-b4fff530-a460-42d7-8565-ba61711fd428 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:47.599562 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b4fff530-a460-42d7-8565-ba61711fd428 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:47.600057 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b4fff530-a460-42d7-8565-ba61711fd428 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:47.601019 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b4fff530-a460-42d7-8565-ba61711fd428 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:47.601630 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b4fff530-a460-42d7-8565-ba61711fd428 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:48.168508 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-b4fff530-a460-42d7-8565-ba61711fd428 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d12a685d9b419fa3606b5f4d1309fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af209f962144de4ae7e3575a3890096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:48.176900 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-b4fff530-a460-42d7-8565-ba61711fd428 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e" status: 200 len: 1361 microversion: 2.1 time: 0.601967 Jul 15 20:38:48.177752 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 140/275] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:47 2022] GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e => generated 1361 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:48.182900 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-78c17304-6ebd-46b2-8485-6324bc12bc16 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:48.183486 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-78c17304-6ebd-46b2-8485-6324bc12bc16 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] [instance: 17705da4-6daf-4403-9461-348f62b9838b] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:48.193713 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-78c17304-6ebd-46b2-8485-6324bc12bc16 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:48.194454 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-78c17304-6ebd-46b2-8485-6324bc12bc16 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:48.195290 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-78c17304-6ebd-46b2-8485-6324bc12bc16 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:48.195713 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-78c17304-6ebd-46b2-8485-6324bc12bc16 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:48.504766 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-78c17304-6ebd-46b2-8485-6324bc12bc16 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd204ddb1baba4bf497d25115cf76a83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6d9917fc484639a0e0793ae14496b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:48.511948 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-78c17304-6ebd-46b2-8485-6324bc12bc16 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] 10.222.0.66 "GET /compute/v2.1/servers/17705da4-6daf-4403-9461-348f62b9838b" status: 200 len: 1314 microversion: 2.1 time: 0.332763 Jul 15 20:38:48.521280 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 141/276] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:48 2022] GET /compute/v2.1/servers/17705da4-6daf-4403-9461-348f62b9838b => generated 1314 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:48.521280 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-f1a3388e-0c8f-4291-be72-25627fb74d83 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:48.521280 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-f1a3388e-0c8f-4291-be72-25627fb74d83 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] [instance: a0bae03b-5d67-44ea-80b7-bbb60da1a301] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:48.525586 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-f1a3388e-0c8f-4291-be72-25627fb74d83 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:48.526036 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-f1a3388e-0c8f-4291-be72-25627fb74d83 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:48.526801 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-f1a3388e-0c8f-4291-be72-25627fb74d83 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:48.527231 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-f1a3388e-0c8f-4291-be72-25627fb74d83 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:48.727238 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-0db9a37d-fdc9-4142-9188-d20f40c4f00a tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Flavor limits 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 20:38:48.727738 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-0db9a37d-fdc9-4142-9188-d20f40c4f00a tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Image limits 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 20:38:48.728237 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-0db9a37d-fdc9-4142-9188-d20f40c4f00a tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Flavor pref 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 20:38:48.730076 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-0db9a37d-fdc9-4142-9188-d20f40c4f00a tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Image pref 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 20:38:48.730532 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-0db9a37d-fdc9-4142-9188-d20f40c4f00a tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 20:38:48.738654 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell0:SELECT=27 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:48.741003 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0db9a37d-fdc9-4142-9188-d20f40c4f00a tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:48.741451 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0db9a37d-fdc9-4142-9188-d20f40c4f00a tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:48.742279 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0db9a37d-fdc9-4142-9188-d20f40c4f00a tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:48.742713 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0db9a37d-fdc9-4142-9188-d20f40c4f00a tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:48.760619 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-0db9a37d-fdc9-4142-9188-d20f40c4f00a tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Getting quotas for project 78a593e163e74a7b9db61133e5c22035. Resources: {'instances', 'ram', 'cores'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 20:38:48.764578 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-0db9a37d-fdc9-4142-9188-d20f40c4f00a tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Getting quotas for user c0b5962b37b2470099436609425f7423 and project 78a593e163e74a7b9db61133e5c22035. Resources: {'instances', 'ram', 'cores'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 20:38:48.782092 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-0db9a37d-fdc9-4142-9188-d20f40c4f00a tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Going to run 1 instances... {{(pid=124432) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 20:38:48.784857 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-0db9a37d-fdc9-4142-9188-d20f40c4f00a tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 0f5cb5b0-4308-42bf-9145-9d88bd8af17c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a759604a-67e3-4c79-b848-5d03d936d7a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 20:38:48.800443 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-f1a3388e-0c8f-4291-be72-25627fb74d83 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932ad1f03da24593a6ad444f6cb95e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129a35d484445db9e141028b2e77497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:48.813318 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-f1a3388e-0c8f-4291-be72-25627fb74d83 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] 10.222.0.66 "GET /compute/v2.1/servers/a0bae03b-5d67-44ea-80b7-bbb60da1a301" status: 200 len: 1497 microversion: 2.1 time: 0.299623 Jul 15 20:38:48.814738 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 142/277] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:48 2022] GET /compute/v2.1/servers/a0bae03b-5d67-44ea-80b7-bbb60da1a301 => generated 1497 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:48.822209 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-b755f596-0968-4199-af1e-140b0231f3e5 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:48.825363 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-b755f596-0968-4199-af1e-140b0231f3e5 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 48c34b54-0234-4763-a6c1-f73c3c075277] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:48.845698 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b755f596-0968-4199-af1e-140b0231f3e5 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:48.846023 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b755f596-0968-4199-af1e-140b0231f3e5 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:48.847072 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b755f596-0968-4199-af1e-140b0231f3e5 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:48.847669 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b755f596-0968-4199-af1e-140b0231f3e5 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:48.879427 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-0db9a37d-fdc9-4142-9188-d20f40c4f00a tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.570530 Jul 15 20:38:48.880706 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 136/278] 10.222.0.66 () {60 vars in 1146 bytes} [Fri Jul 15 20:38:47 2022] POST /compute/v2.1/servers => generated 402 bytes in 1576 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 20:38:48.893459 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-205b5b2f-4ccd-4833-82fc-4d71a540efe2 req-b4e7dfbc-db18-4e9c-ac46-4b756cd0c35c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17705da4-6daf-4403-9461-348f62b9838b", "tag": "bf8cb276-45d9-4ec0-824c-171b78f83937"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:38:48.909279 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-205b5b2f-4ccd-4833-82fc-4d71a540efe2 req-b4e7dfbc-db18-4e9c-ac46-4b756cd0c35c service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:48.909903 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-205b5b2f-4ccd-4833-82fc-4d71a540efe2 req-b4e7dfbc-db18-4e9c-ac46-4b756cd0c35c service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:48.923080 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-205b5b2f-4ccd-4833-82fc-4d71a540efe2 req-b4e7dfbc-db18-4e9c-ac46-4b756cd0c35c service nova] Creating event network-changed:bf8cb276-45d9-4ec0-824c-171b78f83937 for instance 17705da4-6daf-4403-9461-348f62b9838b on hv-cinder-79987 Jul 15 20:38:48.928470 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-205b5b2f-4ccd-4833-82fc-4d71a540efe2 req-b4e7dfbc-db18-4e9c-ac46-4b756cd0c35c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046265 Jul 15 20:38:48.929912 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 137/279] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:38:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:38:48.936105 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-0324d9df-4947-44bd-b9fe-b1f0da52dd07 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:48.938948 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-0324d9df-4947-44bd-b9fe-b1f0da52dd07 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 0f5cb5b0-4308-42bf-9145-9d88bd8af17c] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:49.107811 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-0324d9df-4947-44bd-b9fe-b1f0da52dd07 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:49.125887 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-0324d9df-4947-44bd-b9fe-b1f0da52dd07 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c" status: 200 len: 1241 microversion: 2.1 time: 0.191903 Jul 15 20:38:49.127826 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 138/280] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:48 2022] GET /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c => generated 1241 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:49.200263 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-65d9c8cb-fe5d-4dd0-bdd5-f37bad563ca5 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:49.200958 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-65d9c8cb-fe5d-4dd0-bdd5-f37bad563ca5 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:49.209765 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-65d9c8cb-fe5d-4dd0-bdd5-f37bad563ca5 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:49.212644 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-b755f596-0968-4199-af1e-140b0231f3e5 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:49.215606 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-65d9c8cb-fe5d-4dd0-bdd5-f37bad563ca5 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:49.217390 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-65d9c8cb-fe5d-4dd0-bdd5-f37bad563ca5 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:49.219014 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-65d9c8cb-fe5d-4dd0-bdd5-f37bad563ca5 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:49.222889 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-b755f596-0968-4199-af1e-140b0231f3e5 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277" status: 200 len: 1522 microversion: 2.1 time: 0.406723 Jul 15 20:38:49.223852 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 143/281] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:48 2022] GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277 => generated 1522 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:49.425776 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-97458b0e-7cdb-4c14-838f-1541a625fef3 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:49.426451 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-97458b0e-7cdb-4c14-838f-1541a625fef3 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] [instance: a0bae03b-5d67-44ea-80b7-bbb60da1a301] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:49.432694 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-97458b0e-7cdb-4c14-838f-1541a625fef3 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:49.433215 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-97458b0e-7cdb-4c14-838f-1541a625fef3 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:49.434054 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-97458b0e-7cdb-4c14-838f-1541a625fef3 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:49.434517 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-97458b0e-7cdb-4c14-838f-1541a625fef3 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:49.450858 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-65d9c8cb-fe5d-4dd0-bdd5-f37bad563ca5 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d12a685d9b419fa3606b5f4d1309fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af209f962144de4ae7e3575a3890096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:49.460649 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-65d9c8cb-fe5d-4dd0-bdd5-f37bad563ca5 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e" status: 200 len: 1361 microversion: 2.1 time: 0.269296 Jul 15 20:38:49.462624 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-97458b0e-7cdb-4c14-838f-1541a625fef3 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] [instance: a0bae03b-5d67-44ea-80b7-bbb60da1a301] Going to try to terminate instance {{(pid=124430) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 20:38:49.472258 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 139/282] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:49 2022] GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e => generated 1361 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:49.494400 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_cell1:SELECT=100 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:49.532974 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-058fd7cc-296f-4e8b-8ce3-dc1d6a057e6b tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:49.536933 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-058fd7cc-296f-4e8b-8ce3-dc1d6a057e6b tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] [instance: 17705da4-6daf-4403-9461-348f62b9838b] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:49.546526 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-058fd7cc-296f-4e8b-8ce3-dc1d6a057e6b tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:49.547310 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-058fd7cc-296f-4e8b-8ce3-dc1d6a057e6b tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:49.554619 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-97458b0e-7cdb-4c14-838f-1541a625fef3 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] 10.222.0.66 "DELETE /compute/v2.1/servers/a0bae03b-5d67-44ea-80b7-bbb60da1a301" status: 204 len: 0 microversion: 2.1 time: 0.134877 Jul 15 20:38:49.555519 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 144/283] 10.222.0.66 () {58 vars in 1238 bytes} [Fri Jul 15 20:38:49 2022] DELETE /compute/v2.1/servers/a0bae03b-5d67-44ea-80b7-bbb60da1a301 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 20:38:49.559365 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-058fd7cc-296f-4e8b-8ce3-dc1d6a057e6b tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:49.569059 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-a08fa4be-c2eb-43fd-987a-5aee6584f7cb tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:49.569690 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-a08fa4be-c2eb-43fd-987a-5aee6584f7cb tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] [instance: a0bae03b-5d67-44ea-80b7-bbb60da1a301] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:49.571035 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-058fd7cc-296f-4e8b-8ce3-dc1d6a057e6b tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:49.576130 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-a08fa4be-c2eb-43fd-987a-5aee6584f7cb tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:49.576614 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-a08fa4be-c2eb-43fd-987a-5aee6584f7cb tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:49.578725 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-a08fa4be-c2eb-43fd-987a-5aee6584f7cb tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:49.579175 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-a08fa4be-c2eb-43fd-987a-5aee6584f7cb tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:49.793254 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-058fd7cc-296f-4e8b-8ce3-dc1d6a057e6b tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd204ddb1baba4bf497d25115cf76a83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6d9917fc484639a0e0793ae14496b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:49.800886 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-058fd7cc-296f-4e8b-8ce3-dc1d6a057e6b tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] 10.222.0.66 "GET /compute/v2.1/servers/17705da4-6daf-4403-9461-348f62b9838b" status: 200 len: 1314 microversion: 2.1 time: 0.272414 Jul 15 20:38:49.801455 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 140/284] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:49 2022] GET /compute/v2.1/servers/17705da4-6daf-4403-9461-348f62b9838b => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:49.808833 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-a08fa4be-c2eb-43fd-987a-5aee6584f7cb tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932ad1f03da24593a6ad444f6cb95e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129a35d484445db9e141028b2e77497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:49.814190 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-a08fa4be-c2eb-43fd-987a-5aee6584f7cb tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] 10.222.0.66 "GET /compute/v2.1/servers/a0bae03b-5d67-44ea-80b7-bbb60da1a301" status: 200 len: 1503 microversion: 2.1 time: 0.253165 Jul 15 20:38:49.814772 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 145/285] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:49 2022] GET /compute/v2.1/servers/a0bae03b-5d67-44ea-80b7-bbb60da1a301 => generated 1503 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:38:50.142584 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-f6292e2d-f17c-4de6-9c47-added38fc602 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:50.143187 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-f6292e2d-f17c-4de6-9c47-added38fc602 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 0f5cb5b0-4308-42bf-9145-9d88bd8af17c] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:50.149326 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f6292e2d-f17c-4de6-9c47-added38fc602 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:50.149774 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f6292e2d-f17c-4de6-9c47-added38fc602 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:50.150528 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f6292e2d-f17c-4de6-9c47-added38fc602 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:50.150960 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f6292e2d-f17c-4de6-9c47-added38fc602 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:50.212195 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-f6292e2d-f17c-4de6-9c47-added38fc602 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:50.219738 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-f6292e2d-f17c-4de6-9c47-added38fc602 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c" status: 200 len: 1237 microversion: 2.1 time: 0.080989 Jul 15 20:38:50.220294 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 141/286] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:50 2022] GET /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c => generated 1237 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:50.240754 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-41a9e5cd-1ce8-4ef8-ba06-0f3a8e781282 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:50.241363 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-41a9e5cd-1ce8-4ef8-ba06-0f3a8e781282 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 48c34b54-0234-4763-a6c1-f73c3c075277] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:50.247376 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-41a9e5cd-1ce8-4ef8-ba06-0f3a8e781282 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:50.247841 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-41a9e5cd-1ce8-4ef8-ba06-0f3a8e781282 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:50.248647 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-41a9e5cd-1ce8-4ef8-ba06-0f3a8e781282 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:50.250168 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-41a9e5cd-1ce8-4ef8-ba06-0f3a8e781282 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:50.386544 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-41a9e5cd-1ce8-4ef8-ba06-0f3a8e781282 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:50.394055 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-41a9e5cd-1ce8-4ef8-ba06-0f3a8e781282 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277" status: 200 len: 1522 microversion: 2.1 time: 0.157192 Jul 15 20:38:50.394619 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 146/287] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:50 2022] GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:50.479114 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-04bcc504-14a4-40ca-8917-bcf2d7b22122 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:50.479806 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-04bcc504-14a4-40ca-8917-bcf2d7b22122 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:50.487076 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-04bcc504-14a4-40ca-8917-bcf2d7b22122 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:50.487614 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-04bcc504-14a4-40ca-8917-bcf2d7b22122 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:50.488487 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-04bcc504-14a4-40ca-8917-bcf2d7b22122 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:50.488985 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-04bcc504-14a4-40ca-8917-bcf2d7b22122 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:50.628744 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-04bcc504-14a4-40ca-8917-bcf2d7b22122 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d12a685d9b419fa3606b5f4d1309fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af209f962144de4ae7e3575a3890096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:50.638900 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-04bcc504-14a4-40ca-8917-bcf2d7b22122 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e" status: 200 len: 1361 microversion: 2.1 time: 0.163560 Jul 15 20:38:50.639396 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 142/288] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:50 2022] GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e => generated 1361 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:50.697445 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [req-355e6f63-d97b-4eb8-846f-5f74986b87fe req-3aaa5ddc-c9d2-49bb-bb58-d87e5832e028 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e", "name": "network-vif-plugged", "status": "completed", "tag": "a159b185-0579-4cd7-b4de-9e9d9f79f9a8"}]} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:38:50.707803 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-355e6f63-d97b-4eb8-846f-5f74986b87fe req-3aaa5ddc-c9d2-49bb-bb58-d87e5832e028 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:50.708486 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-355e6f63-d97b-4eb8-846f-5f74986b87fe req-3aaa5ddc-c9d2-49bb-bb58-d87e5832e028 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:50.723313 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.compute.server_external_events [req-355e6f63-d97b-4eb8-846f-5f74986b87fe req-3aaa5ddc-c9d2-49bb-bb58-d87e5832e028 service nova] Creating event network-vif-plugged:a159b185-0579-4cd7-b4de-9e9d9f79f9a8 for instance 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e on hv-cinder-79987 Jul 15 20:38:50.728062 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [req-355e6f63-d97b-4eb8-846f-5f74986b87fe req-3aaa5ddc-c9d2-49bb-bb58-d87e5832e028 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034436 Jul 15 20:38:50.728684 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 147/289] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:38:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:38:50.817809 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-f5527f37-076b-42a9-8d21-1630665473be tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:50.818419 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-f5527f37-076b-42a9-8d21-1630665473be tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] [instance: 17705da4-6daf-4403-9461-348f62b9838b] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:50.824538 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f5527f37-076b-42a9-8d21-1630665473be tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:50.824991 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f5527f37-076b-42a9-8d21-1630665473be tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:50.825757 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f5527f37-076b-42a9-8d21-1630665473be tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:50.826446 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f5527f37-076b-42a9-8d21-1630665473be tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:50.832717 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-3483b2f6-cb75-4db3-8d69-aba36f455805 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:50.833405 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-3483b2f6-cb75-4db3-8d69-aba36f455805 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] [instance: a0bae03b-5d67-44ea-80b7-bbb60da1a301] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:50.839562 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-3483b2f6-cb75-4db3-8d69-aba36f455805 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:50.840002 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-3483b2f6-cb75-4db3-8d69-aba36f455805 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:50.840785 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-3483b2f6-cb75-4db3-8d69-aba36f455805 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:50.841213 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-3483b2f6-cb75-4db3-8d69-aba36f455805 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:51.024074 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-f5527f37-076b-42a9-8d21-1630665473be tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd204ddb1baba4bf497d25115cf76a83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6d9917fc484639a0e0793ae14496b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:51.028262 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-3483b2f6-cb75-4db3-8d69-aba36f455805 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932ad1f03da24593a6ad444f6cb95e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129a35d484445db9e141028b2e77497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:51.032317 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-f5527f37-076b-42a9-8d21-1630665473be tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] 10.222.0.66 "GET /compute/v2.1/servers/17705da4-6daf-4403-9461-348f62b9838b" status: 200 len: 1314 microversion: 2.1 time: 0.218453 Jul 15 20:38:51.032920 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 143/290] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:50 2022] GET /compute/v2.1/servers/17705da4-6daf-4403-9461-348f62b9838b => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:51.036489 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-3483b2f6-cb75-4db3-8d69-aba36f455805 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] 10.222.0.66 "GET /compute/v2.1/servers/a0bae03b-5d67-44ea-80b7-bbb60da1a301" status: 200 len: 1503 microversion: 2.1 time: 0.208014 Jul 15 20:38:51.037035 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 148/291] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:50 2022] GET /compute/v2.1/servers/a0bae03b-5d67-44ea-80b7-bbb60da1a301 => generated 1503 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:51.236873 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-1df39225-fefc-4ce7-826e-1836331f9e8b tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:51.237438 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-1df39225-fefc-4ce7-826e-1836331f9e8b tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 0f5cb5b0-4308-42bf-9145-9d88bd8af17c] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:51.243780 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1df39225-fefc-4ce7-826e-1836331f9e8b tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:51.244245 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1df39225-fefc-4ce7-826e-1836331f9e8b tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:51.245066 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1df39225-fefc-4ce7-826e-1836331f9e8b tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:51.245505 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1df39225-fefc-4ce7-826e-1836331f9e8b tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:51.312082 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-1df39225-fefc-4ce7-826e-1836331f9e8b tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:51.319511 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-1df39225-fefc-4ce7-826e-1836331f9e8b tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c" status: 200 len: 1237 microversion: 2.1 time: 0.086744 Jul 15 20:38:51.320070 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 144/292] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:51 2022] GET /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c => generated 1237 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:51.411308 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-12deffe1-0978-4419-befb-79d93b941e7d tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:51.411917 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-12deffe1-0978-4419-befb-79d93b941e7d tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 48c34b54-0234-4763-a6c1-f73c3c075277] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:51.418118 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-12deffe1-0978-4419-befb-79d93b941e7d tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:51.418554 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-12deffe1-0978-4419-befb-79d93b941e7d tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:51.419297 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-12deffe1-0978-4419-befb-79d93b941e7d tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:51.419719 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-12deffe1-0978-4419-befb-79d93b941e7d tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:51.655007 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-48a8e94c-ce8c-41e9-a183-6698da68e8d0 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:51.655628 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-48a8e94c-ce8c-41e9-a183-6698da68e8d0 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:51.662131 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-48a8e94c-ce8c-41e9-a183-6698da68e8d0 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:51.662582 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-48a8e94c-ce8c-41e9-a183-6698da68e8d0 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:51.663343 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-48a8e94c-ce8c-41e9-a183-6698da68e8d0 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:51.663783 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-48a8e94c-ce8c-41e9-a183-6698da68e8d0 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:51.688766 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-12deffe1-0978-4419-befb-79d93b941e7d tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:51.696543 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-12deffe1-0978-4419-befb-79d93b941e7d tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277" status: 200 len: 1522 microversion: 2.1 time: 0.288998 Jul 15 20:38:51.697097 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 149/293] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:51 2022] GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277 => generated 1522 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:51.792828 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-48a8e94c-ce8c-41e9-a183-6698da68e8d0 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d12a685d9b419fa3606b5f4d1309fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af209f962144de4ae7e3575a3890096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:51.800923 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-48a8e94c-ce8c-41e9-a183-6698da68e8d0 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e" status: 200 len: 1361 microversion: 2.1 time: 0.149821 Jul 15 20:38:51.801498 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 145/294] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:51 2022] GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e => generated 1361 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:38:52.050003 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-3416d110-0247-4d85-9cae-b612e19ffdfc tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:52.050609 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-3416d110-0247-4d85-9cae-b612e19ffdfc tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] [instance: 17705da4-6daf-4403-9461-348f62b9838b] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:52.053465 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-6d7bea67-8849-4636-9fea-d944e3a51f6f tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:52.054076 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-6d7bea67-8849-4636-9fea-d944e3a51f6f tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] [instance: a0bae03b-5d67-44ea-80b7-bbb60da1a301] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:52.056598 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-3416d110-0247-4d85-9cae-b612e19ffdfc tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:52.057038 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-3416d110-0247-4d85-9cae-b612e19ffdfc tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:52.057787 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-3416d110-0247-4d85-9cae-b612e19ffdfc tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:52.058221 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-3416d110-0247-4d85-9cae-b612e19ffdfc tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:52.059960 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6d7bea67-8849-4636-9fea-d944e3a51f6f tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:52.060385 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6d7bea67-8849-4636-9fea-d944e3a51f6f tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:52.061172 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6d7bea67-8849-4636-9fea-d944e3a51f6f tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:52.061789 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6d7bea67-8849-4636-9fea-d944e3a51f6f tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:52.295164 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-3416d110-0247-4d85-9cae-b612e19ffdfc tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd204ddb1baba4bf497d25115cf76a83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6d9917fc484639a0e0793ae14496b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:52.303701 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-3416d110-0247-4d85-9cae-b612e19ffdfc tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] 10.222.0.66 "GET /compute/v2.1/servers/17705da4-6daf-4403-9461-348f62b9838b" status: 200 len: 1314 microversion: 2.1 time: 0.258284 Jul 15 20:38:52.304170 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 150/295] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:52 2022] GET /compute/v2.1/servers/17705da4-6daf-4403-9461-348f62b9838b => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:52.306873 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-6d7bea67-8849-4636-9fea-d944e3a51f6f tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932ad1f03da24593a6ad444f6cb95e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129a35d484445db9e141028b2e77497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:52.315244 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-6d7bea67-8849-4636-9fea-d944e3a51f6f tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] 10.222.0.66 "GET /compute/v2.1/servers/a0bae03b-5d67-44ea-80b7-bbb60da1a301" status: 200 len: 1503 microversion: 2.1 time: 0.265587 Jul 15 20:38:52.315802 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 146/296] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:52 2022] GET /compute/v2.1/servers/a0bae03b-5d67-44ea-80b7-bbb60da1a301 => generated 1503 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:52.336020 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-b799c07b-e176-48b3-b07c-5eeaacadb48e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:52.336664 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-b799c07b-e176-48b3-b07c-5eeaacadb48e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 0f5cb5b0-4308-42bf-9145-9d88bd8af17c] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:52.342684 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b799c07b-e176-48b3-b07c-5eeaacadb48e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:52.343233 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b799c07b-e176-48b3-b07c-5eeaacadb48e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:52.344003 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b799c07b-e176-48b3-b07c-5eeaacadb48e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:52.344485 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b799c07b-e176-48b3-b07c-5eeaacadb48e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:52.414728 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-b799c07b-e176-48b3-b07c-5eeaacadb48e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:52.422834 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-b799c07b-e176-48b3-b07c-5eeaacadb48e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c" status: 200 len: 1293 microversion: 2.1 time: 0.090671 Jul 15 20:38:52.423400 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 151/297] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:52 2022] GET /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c => generated 1293 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:52.715411 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-6110ecef-625e-4586-8c82-6674468525b2 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:52.716022 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-6110ecef-625e-4586-8c82-6674468525b2 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 48c34b54-0234-4763-a6c1-f73c3c075277] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:52.723663 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6110ecef-625e-4586-8c82-6674468525b2 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:52.724566 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6110ecef-625e-4586-8c82-6674468525b2 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:52.725570 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6110ecef-625e-4586-8c82-6674468525b2 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:52.726153 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6110ecef-625e-4586-8c82-6674468525b2 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:52.818221 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-170f0b3f-831a-4f09-a78b-c7aaeaa79d10 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:52.819296 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-170f0b3f-831a-4f09-a78b-c7aaeaa79d10 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:52.828230 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-170f0b3f-831a-4f09-a78b-c7aaeaa79d10 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:52.829084 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-170f0b3f-831a-4f09-a78b-c7aaeaa79d10 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:52.830109 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-170f0b3f-831a-4f09-a78b-c7aaeaa79d10 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:52.830758 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-170f0b3f-831a-4f09-a78b-c7aaeaa79d10 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:53.047154 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-6110ecef-625e-4586-8c82-6674468525b2 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:53.061457 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-6110ecef-625e-4586-8c82-6674468525b2 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277" status: 200 len: 1522 microversion: 2.1 time: 0.350105 Jul 15 20:38:53.063912 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 147/298] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:52 2022] GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277 => generated 1522 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:38:53.076869 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-170f0b3f-831a-4f09-a78b-c7aaeaa79d10 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d12a685d9b419fa3606b5f4d1309fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af209f962144de4ae7e3575a3890096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:53.085379 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-170f0b3f-831a-4f09-a78b-c7aaeaa79d10 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e" status: 200 len: 1361 microversion: 2.1 time: 0.271510 Jul 15 20:38:53.095840 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 152/299] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:52 2022] GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e => generated 1361 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:38:53.284339 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-102a76c5-a522-4e2a-977a-05ab49dc0fb5 req-62c4dec2-aef3-4b96-89fe-8a99420161de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0bae03b-5d67-44ea-80b7-bbb60da1a301", "name": "network-vif-deleted", "tag": "b6b490da-bbb4-4902-93a5-74ee3c23b2b2"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:38:53.293320 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-102a76c5-a522-4e2a-977a-05ab49dc0fb5 req-62c4dec2-aef3-4b96-89fe-8a99420161de service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:53.294026 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-102a76c5-a522-4e2a-977a-05ab49dc0fb5 req-62c4dec2-aef3-4b96-89fe-8a99420161de service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:53.308173 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-102a76c5-a522-4e2a-977a-05ab49dc0fb5 req-62c4dec2-aef3-4b96-89fe-8a99420161de service nova] Creating event network-vif-deleted:b6b490da-bbb4-4902-93a5-74ee3c23b2b2 for instance a0bae03b-5d67-44ea-80b7-bbb60da1a301 on hv-cinder-79987 Jul 15 20:38:53.313178 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-102a76c5-a522-4e2a-977a-05ab49dc0fb5 req-62c4dec2-aef3-4b96-89fe-8a99420161de service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033441 Jul 15 20:38:53.313861 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 148/300] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:38:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 20:38:53.322404 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-c4f997ad-4655-495d-8e57-17171b98b944 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:53.323044 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-c4f997ad-4655-495d-8e57-17171b98b944 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] [instance: 17705da4-6daf-4403-9461-348f62b9838b] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:53.330176 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c4f997ad-4655-495d-8e57-17171b98b944 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:53.330559 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c4f997ad-4655-495d-8e57-17171b98b944 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:53.331329 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c4f997ad-4655-495d-8e57-17171b98b944 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:53.331773 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c4f997ad-4655-495d-8e57-17171b98b944 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:53.333266 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-e67cb065-1d74-4a49-ab24-b21405c69a52 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:53.333993 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-e67cb065-1d74-4a49-ab24-b21405c69a52 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] [instance: a0bae03b-5d67-44ea-80b7-bbb60da1a301] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:53.340199 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e67cb065-1d74-4a49-ab24-b21405c69a52 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:53.340710 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e67cb065-1d74-4a49-ab24-b21405c69a52 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:53.341477 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e67cb065-1d74-4a49-ab24-b21405c69a52 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:53.341909 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e67cb065-1d74-4a49-ab24-b21405c69a52 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:53.426634 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-e67cb065-1d74-4a49-ab24-b21405c69a52 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932ad1f03da24593a6ad444f6cb95e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129a35d484445db9e141028b2e77497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:53.434376 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-e67cb065-1d74-4a49-ab24-b21405c69a52 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] 10.222.0.66 "GET /compute/v2.1/servers/a0bae03b-5d67-44ea-80b7-bbb60da1a301" status: 200 len: 1461 microversion: 2.1 time: 0.105144 Jul 15 20:38:53.434948 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 149/301] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:53 2022] GET /compute/v2.1/servers/a0bae03b-5d67-44ea-80b7-bbb60da1a301 => generated 1461 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:38:53.440343 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-07d79728-f091-4b3d-81b3-897b64436826 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:53.441005 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-07d79728-f091-4b3d-81b3-897b64436826 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 0f5cb5b0-4308-42bf-9145-9d88bd8af17c] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:53.453953 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-07d79728-f091-4b3d-81b3-897b64436826 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:53.454734 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-07d79728-f091-4b3d-81b3-897b64436826 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:53.455743 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-07d79728-f091-4b3d-81b3-897b64436826 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:53.456246 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-07d79728-f091-4b3d-81b3-897b64436826 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:53.505123 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-c4f997ad-4655-495d-8e57-17171b98b944 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd204ddb1baba4bf497d25115cf76a83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6d9917fc484639a0e0793ae14496b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:53.512583 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-c4f997ad-4655-495d-8e57-17171b98b944 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] 10.222.0.66 "GET /compute/v2.1/servers/17705da4-6daf-4403-9461-348f62b9838b" status: 200 len: 1314 microversion: 2.1 time: 0.194730 Jul 15 20:38:53.513236 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 153/302] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:53 2022] GET /compute/v2.1/servers/17705da4-6daf-4403-9461-348f62b9838b => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:53.521195 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-07d79728-f091-4b3d-81b3-897b64436826 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:53.528581 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-07d79728-f091-4b3d-81b3-897b64436826 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c" status: 200 len: 1299 microversion: 2.1 time: 0.092673 Jul 15 20:38:53.529136 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 150/303] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:53 2022] GET /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c => generated 1299 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:54.081105 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-bc87222b-968f-4909-8884-a64cce021475 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:54.081756 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-bc87222b-968f-4909-8884-a64cce021475 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 48c34b54-0234-4763-a6c1-f73c3c075277] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:54.088207 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-bc87222b-968f-4909-8884-a64cce021475 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:54.088684 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-bc87222b-968f-4909-8884-a64cce021475 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:54.089462 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-bc87222b-968f-4909-8884-a64cce021475 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:54.089877 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-bc87222b-968f-4909-8884-a64cce021475 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:54.104555 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-05dc7391-a986-462b-a097-d60c6293aa4e tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:54.106700 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-05dc7391-a986-462b-a097-d60c6293aa4e tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:54.117161 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-05dc7391-a986-462b-a097-d60c6293aa4e tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:54.117953 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-05dc7391-a986-462b-a097-d60c6293aa4e tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:54.118832 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-05dc7391-a986-462b-a097-d60c6293aa4e tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:54.119338 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-05dc7391-a986-462b-a097-d60c6293aa4e tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:54.313831 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-bc87222b-968f-4909-8884-a64cce021475 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:54.317644 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-05dc7391-a986-462b-a097-d60c6293aa4e tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d12a685d9b419fa3606b5f4d1309fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af209f962144de4ae7e3575a3890096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:54.321413 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-bc87222b-968f-4909-8884-a64cce021475 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277" status: 200 len: 1522 microversion: 2.1 time: 0.244401 Jul 15 20:38:54.322339 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 154/304] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:54 2022] GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277 => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:54.325808 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-05dc7391-a986-462b-a097-d60c6293aa4e tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e" status: 200 len: 1361 microversion: 2.1 time: 0.225953 Jul 15 20:38:54.329826 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 151/305] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:54 2022] GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e => generated 1361 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:38:54.451539 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-6c5fa93b-6446-4758-91af-aba178f04e51 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:54.455798 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-6c5fa93b-6446-4758-91af-aba178f04e51 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] [instance: a0bae03b-5d67-44ea-80b7-bbb60da1a301] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:54.467033 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-6c5fa93b-6446-4758-91af-aba178f04e51 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:54.468794 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-6c5fa93b-6446-4758-91af-aba178f04e51 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:54.471694 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-6c5fa93b-6446-4758-91af-aba178f04e51 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:54.472905 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-6c5fa93b-6446-4758-91af-aba178f04e51 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:54.525441 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-6c5fa93b-6446-4758-91af-aba178f04e51 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:54.526126 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-6c5fa93b-6446-4758-91af-aba178f04e51 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:54.526689 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.objects.instance [None req-6c5fa93b-6446-4758-91af-aba178f04e51 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lazy-loading 'fault' on Instance uuid a0bae03b-5d67-44ea-80b7-bbb60da1a301 {{(pid=124430) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 20:38:54.532420 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-f87f3567-4080-4fb2-aabb-3bd242ca88ef tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:54.534159 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-f87f3567-4080-4fb2-aabb-3bd242ca88ef tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] [instance: 17705da4-6daf-4403-9461-348f62b9838b] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:54.541589 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f87f3567-4080-4fb2-aabb-3bd242ca88ef tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:54.544102 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f87f3567-4080-4fb2-aabb-3bd242ca88ef tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:54.545041 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f87f3567-4080-4fb2-aabb-3bd242ca88ef tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:54.545587 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f87f3567-4080-4fb2-aabb-3bd242ca88ef tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:54.612931 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-6c5fa93b-6446-4758-91af-aba178f04e51 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932ad1f03da24593a6ad444f6cb95e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129a35d484445db9e141028b2e77497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:54.624846 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-6c5fa93b-6446-4758-91af-aba178f04e51 tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] 10.222.0.66 "GET /compute/v2.1/servers/a0bae03b-5d67-44ea-80b7-bbb60da1a301" status: 200 len: 1303 microversion: 2.1 time: 0.176927 Jul 15 20:38:54.625870 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 155/306] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:54 2022] GET /compute/v2.1/servers/a0bae03b-5d67-44ea-80b7-bbb60da1a301 => generated 1303 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:54.634821 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-fcb088a5-43b5-4ad4-8162-fade2a827af8 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:54.642793 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-fcb088a5-43b5-4ad4-8162-fade2a827af8 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 0f5cb5b0-4308-42bf-9145-9d88bd8af17c] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:54.658335 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-fcb088a5-43b5-4ad4-8162-fade2a827af8 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:54.658931 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-fcb088a5-43b5-4ad4-8162-fade2a827af8 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:54.659989 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-fcb088a5-43b5-4ad4-8162-fade2a827af8 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:54.660726 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-fcb088a5-43b5-4ad4-8162-fade2a827af8 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:54.874756 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-f87f3567-4080-4fb2-aabb-3bd242ca88ef tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd204ddb1baba4bf497d25115cf76a83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6d9917fc484639a0e0793ae14496b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:54.882244 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-f87f3567-4080-4fb2-aabb-3bd242ca88ef tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] 10.222.0.66 "GET /compute/v2.1/servers/17705da4-6daf-4403-9461-348f62b9838b" status: 200 len: 1314 microversion: 2.1 time: 0.355871 Jul 15 20:38:54.882947 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 152/307] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:54 2022] GET /compute/v2.1/servers/17705da4-6daf-4403-9461-348f62b9838b => generated 1314 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:54.887093 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-846c5bd4-41af-4a0f-bfe2-d175f363aa31 req-8cd467a7-4eef-49a7-98e2-d3b57fa09020 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17705da4-6daf-4403-9461-348f62b9838b", "name": "network-vif-plugged", "status": "completed", "tag": "bf8cb276-45d9-4ec0-824c-171b78f83937"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:38:54.894929 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-846c5bd4-41af-4a0f-bfe2-d175f363aa31 req-8cd467a7-4eef-49a7-98e2-d3b57fa09020 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:54.895371 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-846c5bd4-41af-4a0f-bfe2-d175f363aa31 req-8cd467a7-4eef-49a7-98e2-d3b57fa09020 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:54.906317 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-fcb088a5-43b5-4ad4-8162-fade2a827af8 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:54.908659 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-846c5bd4-41af-4a0f-bfe2-d175f363aa31 req-8cd467a7-4eef-49a7-98e2-d3b57fa09020 service nova] Creating event network-vif-plugged:bf8cb276-45d9-4ec0-824c-171b78f83937 for instance 17705da4-6daf-4403-9461-348f62b9838b on hv-cinder-79987 Jul 15 20:38:54.914350 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-846c5bd4-41af-4a0f-bfe2-d175f363aa31 req-8cd467a7-4eef-49a7-98e2-d3b57fa09020 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030465 Jul 15 20:38:54.915003 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 153/308] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:38:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:38:54.919691 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-fcb088a5-43b5-4ad4-8162-fade2a827af8 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c" status: 200 len: 1367 microversion: 2.1 time: 0.291692 Jul 15 20:38:54.920254 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 156/309] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:54 2022] GET /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c => generated 1367 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:54.963319 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-780819fa-4ca9-40e5-a240-ccfa36df0607 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "255742d1-5fd0-417a-8160-d607f99cc9be", "device": "/dev/sdb"}} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:38:54.965014 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-780819fa-4ca9-40e5-a240-ccfa36df0607 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] [instance: 0d0462a7-7852-48bd-80ae-c0f1a5a93dfc] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:54.971838 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-780819fa-4ca9-40e5-a240-ccfa36df0607 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:54.972290 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-780819fa-4ca9-40e5-a240-ccfa36df0607 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:54.973090 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-780819fa-4ca9-40e5-a240-ccfa36df0607 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:54.973542 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-780819fa-4ca9-40e5-a240-ccfa36df0607 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:55.340242 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-ec605431-0daf-4082-8ee2-af0c40ea0493 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:55.341023 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-ec605431-0daf-4082-8ee2-af0c40ea0493 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 48c34b54-0234-4763-a6c1-f73c3c075277] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:55.358858 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-ec605431-0daf-4082-8ee2-af0c40ea0493 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:55.362724 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-ec605431-0daf-4082-8ee2-af0c40ea0493 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:55.367714 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-ec605431-0daf-4082-8ee2-af0c40ea0493 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:55.368306 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-ec605431-0daf-4082-8ee2-af0c40ea0493 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:55.465746 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:55.479361 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-780819fa-4ca9-40e5-a240-ccfa36df0607 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] 10.222.0.66 "POST /compute/v2.1/servers/0d0462a7-7852-48bd-80ae-c0f1a5a93dfc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.519189 Jul 15 20:38:55.492849 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 154/310] 10.222.0.66 () {60 vars in 1322 bytes} [Fri Jul 15 20:38:54 2022] POST /compute/v2.1/servers/0d0462a7-7852-48bd-80ae-c0f1a5a93dfc/os-volume_attachments => generated 194 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:38:55.510390 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-312c7f1e-d1fe-4250-b493-04ec32f02617 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:55.521318 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-312c7f1e-d1fe-4250-b493-04ec32f02617 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:55.529748 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-312c7f1e-d1fe-4250-b493-04ec32f02617 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:55.530952 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-312c7f1e-d1fe-4250-b493-04ec32f02617 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:55.532712 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-312c7f1e-d1fe-4250-b493-04ec32f02617 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:55.533368 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-312c7f1e-d1fe-4250-b493-04ec32f02617 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:55.548257 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_cell0:SELECT=12 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:55.646716 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-ec605431-0daf-4082-8ee2-af0c40ea0493 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:55.659381 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-ec605431-0daf-4082-8ee2-af0c40ea0493 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277" status: 200 len: 1522 microversion: 2.1 time: 0.324019 Jul 15 20:38:55.671041 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 157/311] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:55 2022] GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277 => generated 1522 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:55.675835 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-5d8049b5-2e49-4335-a689-232169cc1f4c tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:55.676469 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-5d8049b5-2e49-4335-a689-232169cc1f4c tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] [instance: a0bae03b-5d67-44ea-80b7-bbb60da1a301] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:55.684099 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-5d8049b5-2e49-4335-a689-232169cc1f4c tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:55.684609 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-5d8049b5-2e49-4335-a689-232169cc1f4c tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:55.685374 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-5d8049b5-2e49-4335-a689-232169cc1f4c tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:55.685966 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-5d8049b5-2e49-4335-a689-232169cc1f4c tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:55.708930 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.wsgi [None req-5d8049b5-2e49-4335-a689-232169cc1f4c tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] HTTP exception thrown: Instance a0bae03b-5d67-44ea-80b7-bbb60da1a301 could not be found. Jul 15 20:38:55.711448 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-5d8049b5-2e49-4335-a689-232169cc1f4c tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Request method failure captured: Jul 15 20:38:55.711448 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: request: GET /compute/v2.1/servers/a0bae03b-5d67-44ea-80b7-bbb60da1a301 HTTP/1.1 Jul 15 20:38:55.711448 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Accept: application/json Jul 15 20:38:55.711448 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Accept-Encoding: identity Jul 15 20:38:55.711448 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Connection: close Jul 15 20:38:55.711448 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Content-Length: 0 Jul 15 20:38:55.711448 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Content-Type: application/json Jul 15 20:38:55.711448 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Host: 10.222.0.66 Jul 15 20:38:55.711448 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Openstack-System-Scope: None Jul 15 20:38:55.711448 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: User-Agent: python-urllib3/1.26.9 Jul 15 20:38:55.711448 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Auth-Token: gAAAAABi0dAo0JwHkqzrSh_Nl87PnMeAZb6_zGNmshcMxdpuxHmlGCwxVdYqiWW7DS2wcZoqT2-yV8NPOSE5Q0KQWripp-rT6nZzEKdrQ4uYWGG--NkM6GkWasX5sMgE9CJgO5fMAFCO99LgUiuncYA_3Me2cF8zuKQmeKTDME0dKXjRzTCCAcs Jul 15 20:38:55.711448 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Domain-Id: None Jul 15 20:38:55.711448 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Domain-Name: None Jul 15 20:38:55.711448 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Identity-Status: Confirmed Jul 15 20:38:55.711448 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Is-Admin-Project: True Jul 15 20:38:55.711448 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Domain-Id: default Jul 15 20:38:55.711448 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Domain-Name: Default Jul 15 20:38:55.711448 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Id: 3129a35d484445db9e141028b2e77497 Jul 15 20:38:55.711448 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Name: tempest-VolumesActionsTest-537258293 Jul 15 20:38:55.711448 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Role: member,reader Jul 15 20:38:55.711448 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Roles: member,reader Jul 15 20:38:55.714119 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3129a35d484445db9e141028b2e77497"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_3129a35d484445db9e141028b2e77497"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3129a35d484445db9e141028b2e77497"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/3129a35d484445db9e141028b2e77497"}]}] Jul 15 20:38:55.714119 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant: tempest-VolumesActionsTest-537258293 Jul 15 20:38:55.714119 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant-Id: 3129a35d484445db9e141028b2e77497 Jul 15 20:38:55.714119 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant-Name: tempest-VolumesActionsTest-537258293 Jul 15 20:38:55.714119 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User: tempest-VolumesActionsTest-537258293-project Jul 15 20:38:55.714119 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Domain-Id: default Jul 15 20:38:55.714119 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Domain-Name: Default Jul 15 20:38:55.714119 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Id: 932ad1f03da24593a6ad444f6cb95e6d Jul 15 20:38:55.714119 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Name: tempest-VolumesActionsTest-537258293-project Jul 15 20:38:55.714119 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: method: > Jul 15 20:38:55.714119 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: exception: Instance a0bae03b-5d67-44ea-80b7-bbb60da1a301 could not be found. Jul 15 20:38:55.714119 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: action_args: {'id': 'a0bae03b-5d67-44ea-80b7-bbb60da1a301'} Jul 15 20:38:55.714831 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 20:38:55.714831 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:38:55.714831 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 20:38:55.714831 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 20:38:55.714831 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 20:38:55.714831 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 20:38:55.714831 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 20:38:55.714831 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 20:38:55.714831 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 20:38:55.714831 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 20:38:55.714831 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0bae03b-5d67-44ea-80b7-bbb60da1a301 could not be found. Jul 15 20:38:55.714831 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:38:55.714831 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:38:55.714831 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:38:55.714831 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:38:55.714831 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:38:55.714831 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:38:55.714831 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 20:38:55.714831 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 20:38:55.714831 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 20:38:55.719505 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 20:38:55.719505 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 20:38:55.719505 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 20:38:55.719505 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 20:38:55.719505 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 20:38:55.719505 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 20:38:55.719505 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 20:38:55.719505 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0bae03b-5d67-44ea-80b7-bbb60da1a301 could not be found. Jul 15 20:38:55.719505 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:38:55.719505 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:38:55.719505 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:38:55.719505 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:38:55.719505 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:38:55.719505 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:38:55.719505 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 20:38:55.719505 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 20:38:55.719505 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0bae03b-5d67-44ea-80b7-bbb60da1a301 could not be found. Jul 15 20:38:55.719505 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:38:55.721945 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-5d8049b5-2e49-4335-a689-232169cc1f4c tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] Returning 404 to user: Instance a0bae03b-5d67-44ea-80b7-bbb60da1a301 could not be found. {{(pid=124430) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 20:38:55.721945 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-5d8049b5-2e49-4335-a689-232169cc1f4c tempest-VolumesActionsTest-537258293 tempest-VolumesActionsTest-537258293-project] 10.222.0.66 "GET /compute/v2.1/servers/a0bae03b-5d67-44ea-80b7-bbb60da1a301" status: 404 len: 111 microversion: 2.1 time: 0.040576 Jul 15 20:38:55.721945 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 158/312] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:55 2022] GET /compute/v2.1/servers/a0bae03b-5d67-44ea-80b7-bbb60da1a301 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 20:38:55.746173 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-312c7f1e-d1fe-4250-b493-04ec32f02617 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d12a685d9b419fa3606b5f4d1309fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af209f962144de4ae7e3575a3890096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:55.761709 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-312c7f1e-d1fe-4250-b493-04ec32f02617 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e" status: 200 len: 1546 microversion: 2.1 time: 0.267066 Jul 15 20:38:55.762643 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 155/313] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:55 2022] GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e => generated 1546 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:55.783589 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-356b31d7-7b03-41fb-bca7-717ad9624da2 req-47b52ba7-40f4-4a1c-8ab4-736d378ae398 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f5cb5b0-4308-42bf-9145-9d88bd8af17c", "tag": "1f2f6332-7e5b-4cf3-9154-434d47672d10"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:38:55.784493 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-8752a05a-cf98-451e-be41-5414351222cd tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:55.785124 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-8752a05a-cf98-451e-be41-5414351222cd tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:55.799744 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8752a05a-cf98-451e-be41-5414351222cd tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:55.800356 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8752a05a-cf98-451e-be41-5414351222cd tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:55.801087 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-356b31d7-7b03-41fb-bca7-717ad9624da2 req-47b52ba7-40f4-4a1c-8ab4-736d378ae398 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:55.801197 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8752a05a-cf98-451e-be41-5414351222cd tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:55.801740 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-356b31d7-7b03-41fb-bca7-717ad9624da2 req-47b52ba7-40f4-4a1c-8ab4-736d378ae398 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:55.801859 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8752a05a-cf98-451e-be41-5414351222cd tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:55.819820 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-356b31d7-7b03-41fb-bca7-717ad9624da2 req-47b52ba7-40f4-4a1c-8ab4-736d378ae398 service nova] Creating event network-changed:1f2f6332-7e5b-4cf3-9154-434d47672d10 for instance 0f5cb5b0-4308-42bf-9145-9d88bd8af17c on hv-cinder-79987 Jul 15 20:38:55.827687 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-356b31d7-7b03-41fb-bca7-717ad9624da2 req-47b52ba7-40f4-4a1c-8ab4-736d378ae398 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047690 Jul 15 20:38:55.828942 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 156/314] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:38:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 20:38:55.900444 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-3f1bcf02-36f4-49a5-8589-63a27d963b31 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:55.901340 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-3f1bcf02-36f4-49a5-8589-63a27d963b31 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] [instance: 17705da4-6daf-4403-9461-348f62b9838b] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:55.907197 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-8752a05a-cf98-451e-be41-5414351222cd tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.129548 Jul 15 20:38:55.907793 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 159/315] 10.222.0.66 () {58 vars in 1274 bytes} [Fri Jul 15 20:38:55 2022] GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e/os-interface => generated 284 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:38:55.909003 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3f1bcf02-36f4-49a5-8589-63a27d963b31 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:55.909630 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3f1bcf02-36f4-49a5-8589-63a27d963b31 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:55.910578 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3f1bcf02-36f4-49a5-8589-63a27d963b31 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:55.911014 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3f1bcf02-36f4-49a5-8589-63a27d963b31 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:55.939271 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-bf71af5f-bffb-4a69-9b98-a66993259712 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:55.939772 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-bf71af5f-bffb-4a69-9b98-a66993259712 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 0f5cb5b0-4308-42bf-9145-9d88bd8af17c] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:55.960458 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-bf71af5f-bffb-4a69-9b98-a66993259712 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:55.961587 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-bf71af5f-bffb-4a69-9b98-a66993259712 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:55.962388 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-bf71af5f-bffb-4a69-9b98-a66993259712 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:55.962986 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-bf71af5f-bffb-4a69-9b98-a66993259712 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:56.129524 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-3f1bcf02-36f4-49a5-8589-63a27d963b31 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd204ddb1baba4bf497d25115cf76a83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6d9917fc484639a0e0793ae14496b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:56.160726 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-3f1bcf02-36f4-49a5-8589-63a27d963b31 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] 10.222.0.66 "GET /compute/v2.1/servers/17705da4-6daf-4403-9461-348f62b9838b" status: 200 len: 1314 microversion: 2.1 time: 0.259413 Jul 15 20:38:56.161830 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 157/316] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:55 2022] GET /compute/v2.1/servers/17705da4-6daf-4403-9461-348f62b9838b => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:56.218860 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-bf71af5f-bffb-4a69-9b98-a66993259712 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:56.228010 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-bf71af5f-bffb-4a69-9b98-a66993259712 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c" status: 200 len: 1367 microversion: 2.1 time: 0.294519 Jul 15 20:38:56.228596 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 160/317] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:55 2022] GET /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c => generated 1367 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:56.677526 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-b1162252-39a5-4c54-845c-5fd8780f6fa9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:56.678250 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-b1162252-39a5-4c54-845c-5fd8780f6fa9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 48c34b54-0234-4763-a6c1-f73c3c075277] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:56.690118 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b1162252-39a5-4c54-845c-5fd8780f6fa9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:56.690118 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b1162252-39a5-4c54-845c-5fd8780f6fa9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:56.690118 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b1162252-39a5-4c54-845c-5fd8780f6fa9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:56.690118 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b1162252-39a5-4c54-845c-5fd8780f6fa9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:56.838478 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-b1162252-39a5-4c54-845c-5fd8780f6fa9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:56.846183 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-b1162252-39a5-4c54-845c-5fd8780f6fa9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277" status: 200 len: 1522 microversion: 2.1 time: 0.173325 Jul 15 20:38:56.846996 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 158/318] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:56 2022] GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:38:57.177712 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-a3fbc9d9-8d69-42d1-a775-b3153d3a0ede tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:57.178323 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-a3fbc9d9-8d69-42d1-a775-b3153d3a0ede tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] [instance: 17705da4-6daf-4403-9461-348f62b9838b] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:57.185029 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-a3fbc9d9-8d69-42d1-a775-b3153d3a0ede tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:57.185480 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-a3fbc9d9-8d69-42d1-a775-b3153d3a0ede tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:57.186888 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-a3fbc9d9-8d69-42d1-a775-b3153d3a0ede tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:57.187337 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-a3fbc9d9-8d69-42d1-a775-b3153d3a0ede tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:57.253197 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-a9cd5ef1-7f3d-4f2a-9ac2-66b1069c9787 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:57.253851 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-a9cd5ef1-7f3d-4f2a-9ac2-66b1069c9787 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 0f5cb5b0-4308-42bf-9145-9d88bd8af17c] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:57.261012 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a9cd5ef1-7f3d-4f2a-9ac2-66b1069c9787 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:57.261465 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a9cd5ef1-7f3d-4f2a-9ac2-66b1069c9787 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:57.262257 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a9cd5ef1-7f3d-4f2a-9ac2-66b1069c9787 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:57.262690 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a9cd5ef1-7f3d-4f2a-9ac2-66b1069c9787 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:57.363567 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-a3fbc9d9-8d69-42d1-a775-b3153d3a0ede tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd204ddb1baba4bf497d25115cf76a83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6d9917fc484639a0e0793ae14496b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:57.367172 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:57.374325 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-a3fbc9d9-8d69-42d1-a775-b3153d3a0ede tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] 10.222.0.66 "GET /compute/v2.1/servers/17705da4-6daf-4403-9461-348f62b9838b" status: 200 len: 1314 microversion: 2.1 time: 0.199864 Jul 15 20:38:57.379616 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 161/319] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:57 2022] GET /compute/v2.1/servers/17705da4-6daf-4403-9461-348f62b9838b => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:57.420160 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-a9cd5ef1-7f3d-4f2a-9ac2-66b1069c9787 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:57.427924 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-a9cd5ef1-7f3d-4f2a-9ac2-66b1069c9787 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c" status: 200 len: 1367 microversion: 2.1 time: 0.179521 Jul 15 20:38:57.428717 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 159/320] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:57 2022] GET /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:57.842153 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [req-891d9740-d7a2-486a-80c3-c5e1c8eb69db req-01bbb953-356b-453e-9fef-47f7e53510f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e", "tag": "a159b185-0579-4cd7-b4de-9e9d9f79f9a8"}]} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:38:57.852935 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-891d9740-d7a2-486a-80c3-c5e1c8eb69db req-01bbb953-356b-453e-9fef-47f7e53510f1 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:57.853377 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-891d9740-d7a2-486a-80c3-c5e1c8eb69db req-01bbb953-356b-453e-9fef-47f7e53510f1 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:57.864339 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-d8e0d35f-21f1-4a2d-baec-c3168902dd39 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:57.865053 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-d8e0d35f-21f1-4a2d-baec-c3168902dd39 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 48c34b54-0234-4763-a6c1-f73c3c075277] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:57.865654 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.compute.server_external_events [req-891d9740-d7a2-486a-80c3-c5e1c8eb69db req-01bbb953-356b-453e-9fef-47f7e53510f1 service nova] Creating event network-changed:a159b185-0579-4cd7-b4de-9e9d9f79f9a8 for instance 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e on hv-cinder-79987 Jul 15 20:38:57.871522 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [req-891d9740-d7a2-486a-80c3-c5e1c8eb69db req-01bbb953-356b-453e-9fef-47f7e53510f1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033123 Jul 15 20:38:57.872674 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d8e0d35f-21f1-4a2d-baec-c3168902dd39 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:57.872824 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 162/321] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:38:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:38:57.873481 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d8e0d35f-21f1-4a2d-baec-c3168902dd39 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:57.875535 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d8e0d35f-21f1-4a2d-baec-c3168902dd39 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:57.875968 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d8e0d35f-21f1-4a2d-baec-c3168902dd39 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:58.007329 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-d8e0d35f-21f1-4a2d-baec-c3168902dd39 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:58.014821 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-d8e0d35f-21f1-4a2d-baec-c3168902dd39 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277" status: 200 len: 1522 microversion: 2.1 time: 0.154423 Jul 15 20:38:58.015486 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 160/322] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:57 2022] GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:58.392324 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-aaffe50d-5adc-4424-87a5-a15855ae0cb0 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:58.393179 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-aaffe50d-5adc-4424-87a5-a15855ae0cb0 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] [instance: 17705da4-6daf-4403-9461-348f62b9838b] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:58.400111 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-aaffe50d-5adc-4424-87a5-a15855ae0cb0 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:58.400606 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-aaffe50d-5adc-4424-87a5-a15855ae0cb0 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:58.401386 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-aaffe50d-5adc-4424-87a5-a15855ae0cb0 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:58.401828 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-aaffe50d-5adc-4424-87a5-a15855ae0cb0 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:58.445190 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-3447239a-39dc-43b7-86fe-fbf9c5cb84b6 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:58.445784 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-3447239a-39dc-43b7-86fe-fbf9c5cb84b6 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 0f5cb5b0-4308-42bf-9145-9d88bd8af17c] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:58.453149 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3447239a-39dc-43b7-86fe-fbf9c5cb84b6 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:58.453986 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3447239a-39dc-43b7-86fe-fbf9c5cb84b6 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:58.454764 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3447239a-39dc-43b7-86fe-fbf9c5cb84b6 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:58.455357 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3447239a-39dc-43b7-86fe-fbf9c5cb84b6 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:58.750974 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell0:SELECT=6 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:58.818172 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-aaffe50d-5adc-4424-87a5-a15855ae0cb0 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd204ddb1baba4bf497d25115cf76a83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6d9917fc484639a0e0793ae14496b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:58.826916 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-aaffe50d-5adc-4424-87a5-a15855ae0cb0 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] 10.222.0.66 "GET /compute/v2.1/servers/17705da4-6daf-4403-9461-348f62b9838b" status: 200 len: 1314 microversion: 2.1 time: 0.439421 Jul 15 20:38:58.829079 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 163/323] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:58 2022] GET /compute/v2.1/servers/17705da4-6daf-4403-9461-348f62b9838b => generated 1314 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:58.854547 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-3447239a-39dc-43b7-86fe-fbf9c5cb84b6 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:58.862793 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-3447239a-39dc-43b7-86fe-fbf9c5cb84b6 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c" status: 200 len: 1367 microversion: 2.1 time: 0.421396 Jul 15 20:38:58.863369 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 161/324] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:58 2022] GET /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c => generated 1367 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:38:59.030838 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-e26fc053-5bf9-4e92-b7fd-d6d8cdc4a025 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:59.031370 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-e26fc053-5bf9-4e92-b7fd-d6d8cdc4a025 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 48c34b54-0234-4763-a6c1-f73c3c075277] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:59.037440 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e26fc053-5bf9-4e92-b7fd-d6d8cdc4a025 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:59.037894 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e26fc053-5bf9-4e92-b7fd-d6d8cdc4a025 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:59.038654 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e26fc053-5bf9-4e92-b7fd-d6d8cdc4a025 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:59.039092 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e26fc053-5bf9-4e92-b7fd-d6d8cdc4a025 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:59.169719 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-e26fc053-5bf9-4e92-b7fd-d6d8cdc4a025 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:38:59.177703 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-e26fc053-5bf9-4e92-b7fd-d6d8cdc4a025 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277" status: 200 len: 1522 microversion: 2.1 time: 0.150917 Jul 15 20:38:59.178253 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 164/325] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:59 2022] GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:38:59.846076 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-1dceac32-fbe4-41fe-b0f3-b361f4be8d23 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:59.846685 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-1dceac32-fbe4-41fe-b0f3-b361f4be8d23 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] [instance: 17705da4-6daf-4403-9461-348f62b9838b] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:59.849079 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell0:SELECT=7 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:38:59.854908 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1dceac32-fbe4-41fe-b0f3-b361f4be8d23 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:59.855359 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1dceac32-fbe4-41fe-b0f3-b361f4be8d23 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:59.856126 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1dceac32-fbe4-41fe-b0f3-b361f4be8d23 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:59.856608 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1dceac32-fbe4-41fe-b0f3-b361f4be8d23 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:59.880376 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-afbdfe11-0bc8-4c5d-be14-c73f9499eaf0 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:38:59.881352 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-afbdfe11-0bc8-4c5d-be14-c73f9499eaf0 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 0f5cb5b0-4308-42bf-9145-9d88bd8af17c] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:38:59.888167 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-afbdfe11-0bc8-4c5d-be14-c73f9499eaf0 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:59.888761 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-afbdfe11-0bc8-4c5d-be14-c73f9499eaf0 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:38:59.890233 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-afbdfe11-0bc8-4c5d-be14-c73f9499eaf0 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:38:59.890835 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-afbdfe11-0bc8-4c5d-be14-c73f9499eaf0 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:00.037223 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-1dceac32-fbe4-41fe-b0f3-b361f4be8d23 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd204ddb1baba4bf497d25115cf76a83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6d9917fc484639a0e0793ae14496b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:00.045311 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-1dceac32-fbe4-41fe-b0f3-b361f4be8d23 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] 10.222.0.66 "GET /compute/v2.1/servers/17705da4-6daf-4403-9461-348f62b9838b" status: 200 len: 1314 microversion: 2.1 time: 0.203891 Jul 15 20:39:00.046466 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 162/326] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:59 2022] GET /compute/v2.1/servers/17705da4-6daf-4403-9461-348f62b9838b => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:00.068367 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-afbdfe11-0bc8-4c5d-be14-c73f9499eaf0 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:00.075674 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-afbdfe11-0bc8-4c5d-be14-c73f9499eaf0 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c" status: 200 len: 1367 microversion: 2.1 time: 0.199532 Jul 15 20:39:00.076229 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 165/327] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:38:59 2022] GET /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c => generated 1367 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:00.194970 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-ca5e927a-c674-4609-8a09-d91100c845ff tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:00.195579 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-ca5e927a-c674-4609-8a09-d91100c845ff tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 48c34b54-0234-4763-a6c1-f73c3c075277] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:00.201796 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ca5e927a-c674-4609-8a09-d91100c845ff tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:00.202446 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ca5e927a-c674-4609-8a09-d91100c845ff tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:00.203202 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ca5e927a-c674-4609-8a09-d91100c845ff tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:00.203639 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ca5e927a-c674-4609-8a09-d91100c845ff tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:00.332788 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-ca5e927a-c674-4609-8a09-d91100c845ff tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:00.340569 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-ca5e927a-c674-4609-8a09-d91100c845ff tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277" status: 200 len: 1522 microversion: 2.1 time: 0.149346 Jul 15 20:39:00.341137 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 163/328] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:00 2022] GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:01.063611 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-e4917ebc-f52d-4793-8ba7-2bedcf7cdfc8 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:01.064544 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-e4917ebc-f52d-4793-8ba7-2bedcf7cdfc8 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] [instance: 17705da4-6daf-4403-9461-348f62b9838b] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:01.071316 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e4917ebc-f52d-4793-8ba7-2bedcf7cdfc8 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:01.071767 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e4917ebc-f52d-4793-8ba7-2bedcf7cdfc8 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:01.072650 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e4917ebc-f52d-4793-8ba7-2bedcf7cdfc8 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:01.073141 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e4917ebc-f52d-4793-8ba7-2bedcf7cdfc8 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:01.092134 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-c8bba0db-40ee-4051-aa7c-6f600ae17daf tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:01.093352 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-c8bba0db-40ee-4051-aa7c-6f600ae17daf tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 0f5cb5b0-4308-42bf-9145-9d88bd8af17c] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:01.103773 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c8bba0db-40ee-4051-aa7c-6f600ae17daf tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:01.104229 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c8bba0db-40ee-4051-aa7c-6f600ae17daf tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:01.109394 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c8bba0db-40ee-4051-aa7c-6f600ae17daf tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:01.109885 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c8bba0db-40ee-4051-aa7c-6f600ae17daf tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:01.362995 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-e4917ebc-f52d-4793-8ba7-2bedcf7cdfc8 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd204ddb1baba4bf497d25115cf76a83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6d9917fc484639a0e0793ae14496b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:01.380426 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-e4917ebc-f52d-4793-8ba7-2bedcf7cdfc8 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] 10.222.0.66 "GET /compute/v2.1/servers/17705da4-6daf-4403-9461-348f62b9838b" status: 200 len: 1463 microversion: 2.1 time: 0.321118 Jul 15 20:39:01.381787 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 166/329] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:01 2022] GET /compute/v2.1/servers/17705da4-6daf-4403-9461-348f62b9838b => generated 1463 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:01.410053 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-bda5f9c2-e2f2-4b82-9153-d57ac8a85cd1 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:01.419092 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-bda5f9c2-e2f2-4b82-9153-d57ac8a85cd1 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 48c34b54-0234-4763-a6c1-f73c3c075277] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:01.434535 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-bda5f9c2-e2f2-4b82-9153-d57ac8a85cd1 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:01.435765 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-bda5f9c2-e2f2-4b82-9153-d57ac8a85cd1 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:01.436768 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-bda5f9c2-e2f2-4b82-9153-d57ac8a85cd1 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:01.437401 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-bda5f9c2-e2f2-4b82-9153-d57ac8a85cd1 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:01.495058 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-c8bba0db-40ee-4051-aa7c-6f600ae17daf tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:01.506313 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-c8bba0db-40ee-4051-aa7c-6f600ae17daf tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c" status: 200 len: 1367 microversion: 2.1 time: 0.417843 Jul 15 20:39:01.508917 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 164/330] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:01 2022] GET /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c => generated 1367 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:01.515642 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-a5cf66e4-12af-4fb6-9fb1-a8b80155b52d tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:01.516546 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-a5cf66e4-12af-4fb6-9fb1-a8b80155b52d tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] [instance: 17705da4-6daf-4403-9461-348f62b9838b] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:01.524297 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a5cf66e4-12af-4fb6-9fb1-a8b80155b52d tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:01.524923 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a5cf66e4-12af-4fb6-9fb1-a8b80155b52d tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:01.525713 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a5cf66e4-12af-4fb6-9fb1-a8b80155b52d tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:01.526149 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a5cf66e4-12af-4fb6-9fb1-a8b80155b52d tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:01.557619 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-a5cf66e4-12af-4fb6-9fb1-a8b80155b52d tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] [instance: 17705da4-6daf-4403-9461-348f62b9838b] Going to try to terminate instance {{(pid=124432) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 20:39:01.631076 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-bda5f9c2-e2f2-4b82-9153-d57ac8a85cd1 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:01.645578 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-bda5f9c2-e2f2-4b82-9153-d57ac8a85cd1 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277" status: 200 len: 1502 microversion: 2.1 time: 0.262582 Jul 15 20:39:01.646536 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 167/331] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:01 2022] GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277 => generated 1502 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:01.663283 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-1f424b57-04b9-44f4-b2c6-eaf30db3317f tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "170c4228-8789-45f5-9d61-d65c20d43cba"}} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:39:01.664763 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-1f424b57-04b9-44f4-b2c6-eaf30db3317f tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 48c34b54-0234-4763-a6c1-f73c3c075277] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:01.666996 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:01.672743 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-1f424b57-04b9-44f4-b2c6-eaf30db3317f tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:01.673394 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-1f424b57-04b9-44f4-b2c6-eaf30db3317f tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:01.674453 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-1f424b57-04b9-44f4-b2c6-eaf30db3317f tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:01.675059 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-1f424b57-04b9-44f4-b2c6-eaf30db3317f tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:01.678469 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-a5cf66e4-12af-4fb6-9fb1-a8b80155b52d tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] 10.222.0.66 "DELETE /compute/v2.1/servers/17705da4-6daf-4403-9461-348f62b9838b" status: 204 len: 0 microversion: 2.1 time: 0.167498 Jul 15 20:39:01.682832 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 165/332] 10.222.0.66 () {58 vars in 1238 bytes} [Fri Jul 15 20:39:01 2022] DELETE /compute/v2.1/servers/17705da4-6daf-4403-9461-348f62b9838b => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 20:39:01.692645 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-fdc055a0-1058-4307-a373-cdf8a48b4fff tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:01.693602 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-fdc055a0-1058-4307-a373-cdf8a48b4fff tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] [instance: 17705da4-6daf-4403-9461-348f62b9838b] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:01.702458 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fdc055a0-1058-4307-a373-cdf8a48b4fff tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:01.703100 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fdc055a0-1058-4307-a373-cdf8a48b4fff tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:01.704602 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fdc055a0-1058-4307-a373-cdf8a48b4fff tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:01.705284 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fdc055a0-1058-4307-a373-cdf8a48b4fff tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:01.718199 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.wsgi [None req-1f424b57-04b9-44f4-b2c6-eaf30db3317f tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] HTTP exception thrown: Cannot 'attach_volume' instance 48c34b54-0234-4763-a6c1-f73c3c075277 while it is in vm_state rescued Jul 15 20:39:01.721272 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-1f424b57-04b9-44f4-b2c6-eaf30db3317f tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Request method failure captured: Jul 15 20:39:01.721272 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: request: POST /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277/os-volume_attachments HTTP/1.1 Jul 15 20:39:01.721272 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Accept: application/json Jul 15 20:39:01.721272 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Accept-Encoding: identity Jul 15 20:39:01.721272 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Connection: close Jul 15 20:39:01.721272 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Content-Length: 74 Jul 15 20:39:01.721272 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Content-Type: application/json Jul 15 20:39:01.721272 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Host: 10.222.0.66 Jul 15 20:39:01.721272 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Openstack-System-Scope: None Jul 15 20:39:01.721272 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: User-Agent: python-urllib3/1.26.9 Jul 15 20:39:01.721272 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Auth-Token: gAAAAABi0c_lkbnVJwqH3IpbVZVWMQ8HLL8u6A1nS9xbrwR6NEMpzbfmtKxCTl345tuTNHTXVBkYUfn70H4FibX8wPsRThE1aLHTgYmYauzCicRFu1CJ8qFyi1jEF3aSJLDbXxeN4ZX8G4ZQcm6oZkgRw4bn00Q4s9ZTfchWhd2dhVKZ6EVvqgw Jul 15 20:39:01.721272 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Domain-Id: None Jul 15 20:39:01.721272 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Domain-Name: None Jul 15 20:39:01.721272 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Identity-Status: Confirmed Jul 15 20:39:01.721272 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Is-Admin-Project: True Jul 15 20:39:01.721272 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Domain-Id: default Jul 15 20:39:01.721272 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Domain-Name: Default Jul 15 20:39:01.721272 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Id: 0395d91380b34e968d7e39be3bc88b0f Jul 15 20:39:01.721272 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1747571758 Jul 15 20:39:01.721272 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Role: member,reader Jul 15 20:39:01.721272 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Roles: member,reader Jul 15 20:39:01.723500 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0395d91380b34e968d7e39be3bc88b0f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_0395d91380b34e968d7e39be3bc88b0f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0395d91380b34e968d7e39be3bc88b0f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/0395d91380b34e968d7e39be3bc88b0f"}]}] Jul 15 20:39:01.723500 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1747571758 Jul 15 20:39:01.723500 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant-Id: 0395d91380b34e968d7e39be3bc88b0f Jul 15 20:39:01.723500 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1747571758 Jul 15 20:39:01.723500 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User: tempest-ServerRescueNegativeTestJSON-1747571758-project Jul 15 20:39:01.723500 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Domain-Id: default Jul 15 20:39:01.723500 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Domain-Name: Default Jul 15 20:39:01.723500 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Id: e13d5d7068e348248387b512c55dec5e Jul 15 20:39:01.723500 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1747571758-project Jul 15 20:39:01.723500 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Jul 15 20:39:01.723500 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: {"volumeAttachment": {"volumeId": "170c4228-8789-45f5-9d61-d65c20d43cba"}} Jul 15 20:39:01.723500 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: method: > Jul 15 20:39:01.724656 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: exception: Cannot 'attach_volume' instance 48c34b54-0234-4763-a6c1-f73c3c075277 while it is in vm_state rescued Jul 15 20:39:01.724656 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: action_args: {'server_id': '48c34b54-0234-4763-a6c1-f73c3c075277', 'body': {'volumeAttachment': {'volumeId': '170c4228-8789-45f5-9d61-d65c20d43cba'}}} Jul 15 20:39:01.724656 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 20:39:01.724656 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:39:01.724656 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 15 20:39:01.724656 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 15 20:39:01.724656 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 15 20:39:01.724656 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 15 20:39:01.724656 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 15 20:39:01.724656 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 15 20:39:01.724656 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 48c34b54-0234-4763-a6c1-f73c3c075277 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 15 20:39:01.724656 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:39:01.724656 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:39:01.724656 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:39:01.724656 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:39:01.724656 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:39:01.724656 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:39:01.724656 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 20:39:01.724656 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 20:39:01.726415 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 20:39:01.726415 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 20:39:01.726415 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 15 20:39:01.726415 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 15 20:39:01.726415 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 15 20:39:01.726415 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 15 20:39:01.726415 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 15 20:39:01.726415 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 15 20:39:01.726415 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 15 20:39:01.726415 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 15 20:39:01.726415 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 15 20:39:01.726415 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 15 20:39:01.726415 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 48c34b54-0234-4763-a6c1-f73c3c075277 while it is in vm_state rescued Jul 15 20:39:01.726415 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:39:01.726415 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:39:01.726415 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:39:01.726415 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:39:01.726415 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:39:01.726415 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:39:01.728034 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 20:39:01.728034 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 20:39:01.728034 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 48c34b54-0234-4763-a6c1-f73c3c075277 while it is in vm_state rescued Jul 15 20:39:01.728034 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:39:01.730437 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-1f424b57-04b9-44f4-b2c6-eaf30db3317f tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Returning 409 to user: Cannot 'attach_volume' instance 48c34b54-0234-4763-a6c1-f73c3c075277 while it is in vm_state rescued {{(pid=124430) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 20:39:01.731543 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-1f424b57-04b9-44f4-b2c6-eaf30db3317f tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "POST /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.072606 Jul 15 20:39:01.732459 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 168/333] 10.222.0.66 () {60 vars in 1322 bytes} [Fri Jul 15 20:39:01 2022] POST /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277/os-volume_attachments => generated 152 bytes in 74 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 15 20:39:01.743911 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-734268cd-6e57-42e7-9f31-8002acf67c04 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:39:01.744936 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-734268cd-6e57-42e7-9f31-8002acf67c04 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 48c34b54-0234-4763-a6c1-f73c3c075277] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:01.755577 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-734268cd-6e57-42e7-9f31-8002acf67c04 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:01.756029 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-734268cd-6e57-42e7-9f31-8002acf67c04 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:01.757052 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-734268cd-6e57-42e7-9f31-8002acf67c04 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:01.757630 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-734268cd-6e57-42e7-9f31-8002acf67c04 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:01.866101 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-734268cd-6e57-42e7-9f31-8002acf67c04 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "POST /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277/action" status: 202 len: 0 microversion: 2.1 time: 0.128181 Jul 15 20:39:01.870357 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 169/334] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 15 20:39:01 2022] POST /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 20:39:01.877151 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-fdc055a0-1058-4307-a373-cdf8a48b4fff tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd204ddb1baba4bf497d25115cf76a83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6d9917fc484639a0e0793ae14496b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:01.885426 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-867e8463-4979-496b-87ed-3586cb50658e tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:01.886498 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-867e8463-4979-496b-87ed-3586cb50658e tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 48c34b54-0234-4763-a6c1-f73c3c075277] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:01.890096 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-fdc055a0-1058-4307-a373-cdf8a48b4fff tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] 10.222.0.66 "GET /compute/v2.1/servers/17705da4-6daf-4403-9461-348f62b9838b" status: 200 len: 1469 microversion: 2.1 time: 0.205729 Jul 15 20:39:01.890968 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 166/335] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:01 2022] GET /compute/v2.1/servers/17705da4-6daf-4403-9461-348f62b9838b => generated 1469 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:01.894972 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-867e8463-4979-496b-87ed-3586cb50658e tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:01.895535 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-867e8463-4979-496b-87ed-3586cb50658e tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:01.896435 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-867e8463-4979-496b-87ed-3586cb50658e tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:01.896964 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-867e8463-4979-496b-87ed-3586cb50658e tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:02.057055 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-867e8463-4979-496b-87ed-3586cb50658e tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:02.069551 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-867e8463-4979-496b-87ed-3586cb50658e tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277" status: 200 len: 1510 microversion: 2.1 time: 0.197621 Jul 15 20:39:02.079597 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 170/336] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:01 2022] GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277 => generated 1510 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:02.523417 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-7cce6749-bea8-4eb8-b186-a7fbc17aaad5 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:02.524375 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-7cce6749-bea8-4eb8-b186-a7fbc17aaad5 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 0f5cb5b0-4308-42bf-9145-9d88bd8af17c] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:02.532907 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7cce6749-bea8-4eb8-b186-a7fbc17aaad5 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:02.533831 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7cce6749-bea8-4eb8-b186-a7fbc17aaad5 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:02.534891 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7cce6749-bea8-4eb8-b186-a7fbc17aaad5 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:02.535471 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7cce6749-bea8-4eb8-b186-a7fbc17aaad5 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:02.760654 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-7cce6749-bea8-4eb8-b186-a7fbc17aaad5 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:02.775710 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-7cce6749-bea8-4eb8-b186-a7fbc17aaad5 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c" status: 200 len: 1367 microversion: 2.1 time: 0.255668 Jul 15 20:39:02.776795 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 167/337] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:02 2022] GET /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c => generated 1367 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:02.911554 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-dbc58151-2176-4211-9bf0-884b180d8743 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:02.912189 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-dbc58151-2176-4211-9bf0-884b180d8743 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] [instance: 17705da4-6daf-4403-9461-348f62b9838b] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:02.919218 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-dbc58151-2176-4211-9bf0-884b180d8743 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:02.919769 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-dbc58151-2176-4211-9bf0-884b180d8743 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:02.920951 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-dbc58151-2176-4211-9bf0-884b180d8743 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:02.921418 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-dbc58151-2176-4211-9bf0-884b180d8743 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:03.096491 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-74452206-fb5b-405f-bdec-1edec17627de tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:03.098272 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-74452206-fb5b-405f-bdec-1edec17627de tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 48c34b54-0234-4763-a6c1-f73c3c075277] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:03.098424 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-dbc58151-2176-4211-9bf0-884b180d8743 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd204ddb1baba4bf497d25115cf76a83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6d9917fc484639a0e0793ae14496b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:03.107611 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-dbc58151-2176-4211-9bf0-884b180d8743 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] 10.222.0.66 "GET /compute/v2.1/servers/17705da4-6daf-4403-9461-348f62b9838b" status: 200 len: 1469 microversion: 2.1 time: 0.201286 Jul 15 20:39:03.111371 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 171/338] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:02 2022] GET /compute/v2.1/servers/17705da4-6daf-4403-9461-348f62b9838b => generated 1469 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:03.118123 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-74452206-fb5b-405f-bdec-1edec17627de tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:03.118583 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-74452206-fb5b-405f-bdec-1edec17627de tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:03.119433 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-74452206-fb5b-405f-bdec-1edec17627de tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:03.119873 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-74452206-fb5b-405f-bdec-1edec17627de tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:03.287377 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-74452206-fb5b-405f-bdec-1edec17627de tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:03.296475 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-74452206-fb5b-405f-bdec-1edec17627de tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277" status: 200 len: 1510 microversion: 2.1 time: 0.209921 Jul 15 20:39:03.306756 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 168/339] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:03 2022] GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277 => generated 1510 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:03.794894 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-99bb4808-28ec-4708-b51f-3c05d58c7763 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:03.795927 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-99bb4808-28ec-4708-b51f-3c05d58c7763 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 0f5cb5b0-4308-42bf-9145-9d88bd8af17c] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:03.806773 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-99bb4808-28ec-4708-b51f-3c05d58c7763 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:03.807405 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-99bb4808-28ec-4708-b51f-3c05d58c7763 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:03.808211 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-99bb4808-28ec-4708-b51f-3c05d58c7763 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:03.808678 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-99bb4808-28ec-4708-b51f-3c05d58c7763 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:03.985042 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-99bb4808-28ec-4708-b51f-3c05d58c7763 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:03.993077 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-99bb4808-28ec-4708-b51f-3c05d58c7763 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c" status: 200 len: 1367 microversion: 2.1 time: 0.203513 Jul 15 20:39:04.002000 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 172/340] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:03 2022] GET /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c => generated 1367 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:04.130663 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-e0531626-24f9-432d-9251-bfdc251af391 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:04.132793 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-e0531626-24f9-432d-9251-bfdc251af391 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] [instance: 17705da4-6daf-4403-9461-348f62b9838b] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:04.140208 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e0531626-24f9-432d-9251-bfdc251af391 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:04.140358 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e0531626-24f9-432d-9251-bfdc251af391 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:04.142395 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e0531626-24f9-432d-9251-bfdc251af391 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:04.142993 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e0531626-24f9-432d-9251-bfdc251af391 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:04.314913 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-a4053704-bdfd-44cf-8b81-ccc56992c0ae tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:04.316209 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-a4053704-bdfd-44cf-8b81-ccc56992c0ae tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 48c34b54-0234-4763-a6c1-f73c3c075277] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:04.330814 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-a4053704-bdfd-44cf-8b81-ccc56992c0ae tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:04.331645 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-a4053704-bdfd-44cf-8b81-ccc56992c0ae tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:04.332669 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-a4053704-bdfd-44cf-8b81-ccc56992c0ae tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:04.333267 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-a4053704-bdfd-44cf-8b81-ccc56992c0ae tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:04.412027 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-e0531626-24f9-432d-9251-bfdc251af391 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd204ddb1baba4bf497d25115cf76a83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6d9917fc484639a0e0793ae14496b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:04.421729 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-e0531626-24f9-432d-9251-bfdc251af391 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] 10.222.0.66 "GET /compute/v2.1/servers/17705da4-6daf-4403-9461-348f62b9838b" status: 200 len: 1469 microversion: 2.1 time: 0.295355 Jul 15 20:39:04.423936 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 169/341] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:04 2022] GET /compute/v2.1/servers/17705da4-6daf-4403-9461-348f62b9838b => generated 1469 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:04.540292 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-a4053704-bdfd-44cf-8b81-ccc56992c0ae tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:04.549196 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-a4053704-bdfd-44cf-8b81-ccc56992c0ae tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277" status: 200 len: 1510 microversion: 2.1 time: 0.238851 Jul 15 20:39:04.558719 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 173/342] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:04 2022] GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277 => generated 1510 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:39:05.012363 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-a60d186e-c03a-4e3f-b672-5b1ef9a7ec88 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:05.014727 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-a60d186e-c03a-4e3f-b672-5b1ef9a7ec88 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 0f5cb5b0-4308-42bf-9145-9d88bd8af17c] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:05.024141 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a60d186e-c03a-4e3f-b672-5b1ef9a7ec88 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:05.026238 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a60d186e-c03a-4e3f-b672-5b1ef9a7ec88 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:05.027271 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a60d186e-c03a-4e3f-b672-5b1ef9a7ec88 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:05.028008 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a60d186e-c03a-4e3f-b672-5b1ef9a7ec88 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:05.069056 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:05.249641 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-a60d186e-c03a-4e3f-b672-5b1ef9a7ec88 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:05.263983 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-a60d186e-c03a-4e3f-b672-5b1ef9a7ec88 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c" status: 200 len: 1367 microversion: 2.1 time: 0.256559 Jul 15 20:39:05.266817 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 170/343] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:05 2022] GET /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c => generated 1367 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:05.451472 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-d6998a38-6d92-4aab-a70f-133a0b7b216d tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:05.452525 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-d6998a38-6d92-4aab-a70f-133a0b7b216d tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] [instance: 17705da4-6daf-4403-9461-348f62b9838b] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:05.460637 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d6998a38-6d92-4aab-a70f-133a0b7b216d tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:05.462696 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d6998a38-6d92-4aab-a70f-133a0b7b216d tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:05.466425 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d6998a38-6d92-4aab-a70f-133a0b7b216d tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:05.467330 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d6998a38-6d92-4aab-a70f-133a0b7b216d tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:05.568215 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-bff8ae6d-025d-4988-99b4-2172bc9e9ee8 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:05.569420 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-bff8ae6d-025d-4988-99b4-2172bc9e9ee8 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 48c34b54-0234-4763-a6c1-f73c3c075277] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:05.579779 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-bff8ae6d-025d-4988-99b4-2172bc9e9ee8 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:05.580799 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-bff8ae6d-025d-4988-99b4-2172bc9e9ee8 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:05.582135 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-bff8ae6d-025d-4988-99b4-2172bc9e9ee8 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:05.582889 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-bff8ae6d-025d-4988-99b4-2172bc9e9ee8 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:05.810937 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-d6998a38-6d92-4aab-a70f-133a0b7b216d tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd204ddb1baba4bf497d25115cf76a83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6d9917fc484639a0e0793ae14496b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:05.820904 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-d6998a38-6d92-4aab-a70f-133a0b7b216d tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] 10.222.0.66 "GET /compute/v2.1/servers/17705da4-6daf-4403-9461-348f62b9838b" status: 200 len: 1469 microversion: 2.1 time: 0.381029 Jul 15 20:39:05.821817 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 174/344] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:05 2022] GET /compute/v2.1/servers/17705da4-6daf-4403-9461-348f62b9838b => generated 1469 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:05.857408 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [req-841b0c18-7a6f-4804-a28f-3b8de9e4a6ea req-f0facbef-56ce-471e-b923-16a70e332aff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17705da4-6daf-4403-9461-348f62b9838b", "name": "network-vif-deleted", "tag": "bf8cb276-45d9-4ec0-824c-171b78f83937"}]} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:39:05.886020 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-841b0c18-7a6f-4804-a28f-3b8de9e4a6ea req-f0facbef-56ce-471e-b923-16a70e332aff service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:05.886475 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-841b0c18-7a6f-4804-a28f-3b8de9e4a6ea req-f0facbef-56ce-471e-b923-16a70e332aff service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:05.888112 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-bff8ae6d-025d-4988-99b4-2172bc9e9ee8 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:05.900836 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.compute.server_external_events [req-841b0c18-7a6f-4804-a28f-3b8de9e4a6ea req-f0facbef-56ce-471e-b923-16a70e332aff service nova] Creating event network-vif-deleted:bf8cb276-45d9-4ec0-824c-171b78f83937 for instance 17705da4-6daf-4403-9461-348f62b9838b on hv-cinder-79987 Jul 15 20:39:05.904536 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-bff8ae6d-025d-4988-99b4-2172bc9e9ee8 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277" status: 200 len: 1510 microversion: 2.1 time: 0.340357 Jul 15 20:39:05.908484 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [req-841b0c18-7a6f-4804-a28f-3b8de9e4a6ea req-f0facbef-56ce-471e-b923-16a70e332aff service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063493 Jul 15 20:39:05.913487 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 171/345] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:05 2022] GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277 => generated 1510 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:39:05.913864 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 175/346] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:39:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 20:39:06.287023 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-386a53ca-1dba-489e-8595-2c0a136869f9 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:06.288012 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-386a53ca-1dba-489e-8595-2c0a136869f9 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 0f5cb5b0-4308-42bf-9145-9d88bd8af17c] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:06.298919 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-386a53ca-1dba-489e-8595-2c0a136869f9 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:06.299561 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-386a53ca-1dba-489e-8595-2c0a136869f9 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:06.300494 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-386a53ca-1dba-489e-8595-2c0a136869f9 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:06.300928 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-386a53ca-1dba-489e-8595-2c0a136869f9 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:06.458464 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-386a53ca-1dba-489e-8595-2c0a136869f9 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:06.467015 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-386a53ca-1dba-489e-8595-2c0a136869f9 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c" status: 200 len: 1367 microversion: 2.1 time: 0.184817 Jul 15 20:39:06.467661 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 172/347] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:06 2022] GET /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:06.845657 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-3ed430d7-5089-49b5-bd39-9da8c9eb5037 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:06.846817 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-3ed430d7-5089-49b5-bd39-9da8c9eb5037 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] [instance: 17705da4-6daf-4403-9461-348f62b9838b] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:06.855137 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-3ed430d7-5089-49b5-bd39-9da8c9eb5037 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:06.855589 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-3ed430d7-5089-49b5-bd39-9da8c9eb5037 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:06.856357 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-3ed430d7-5089-49b5-bd39-9da8c9eb5037 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:06.857384 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-3ed430d7-5089-49b5-bd39-9da8c9eb5037 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:06.927613 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-d182cea5-bf4b-4533-9bdb-6e83bb5f0c77 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:06.928677 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-d182cea5-bf4b-4533-9bdb-6e83bb5f0c77 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 48c34b54-0234-4763-a6c1-f73c3c075277] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:06.931968 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-3ed430d7-5089-49b5-bd39-9da8c9eb5037 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd204ddb1baba4bf497d25115cf76a83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6d9917fc484639a0e0793ae14496b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:06.938117 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d182cea5-bf4b-4533-9bdb-6e83bb5f0c77 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:06.938928 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d182cea5-bf4b-4533-9bdb-6e83bb5f0c77 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:06.939990 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d182cea5-bf4b-4533-9bdb-6e83bb5f0c77 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:06.940480 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d182cea5-bf4b-4533-9bdb-6e83bb5f0c77 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:06.941746 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-3ed430d7-5089-49b5-bd39-9da8c9eb5037 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] 10.222.0.66 "GET /compute/v2.1/servers/17705da4-6daf-4403-9461-348f62b9838b" status: 200 len: 1427 microversion: 2.1 time: 0.104915 Jul 15 20:39:06.942284 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 176/348] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:06 2022] GET /compute/v2.1/servers/17705da4-6daf-4403-9461-348f62b9838b => generated 1427 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:07.142952 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-d182cea5-bf4b-4533-9bdb-6e83bb5f0c77 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:07.149802 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-d182cea5-bf4b-4533-9bdb-6e83bb5f0c77 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277" status: 200 len: 1510 microversion: 2.1 time: 0.226282 Jul 15 20:39:07.160531 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 173/349] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:06 2022] GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277 => generated 1510 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:39:07.486103 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-2bffd7e6-8432-4f13-8c8d-9bf7c4b5571b tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:07.486716 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-2bffd7e6-8432-4f13-8c8d-9bf7c4b5571b tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 0f5cb5b0-4308-42bf-9145-9d88bd8af17c] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:07.493803 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-2bffd7e6-8432-4f13-8c8d-9bf7c4b5571b tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:07.494445 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-2bffd7e6-8432-4f13-8c8d-9bf7c4b5571b tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:07.495400 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-2bffd7e6-8432-4f13-8c8d-9bf7c4b5571b tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:07.495837 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-2bffd7e6-8432-4f13-8c8d-9bf7c4b5571b tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:07.638524 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-2bffd7e6-8432-4f13-8c8d-9bf7c4b5571b tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:07.647833 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-2bffd7e6-8432-4f13-8c8d-9bf7c4b5571b tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c" status: 200 len: 1367 microversion: 2.1 time: 0.166696 Jul 15 20:39:07.648735 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 177/350] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:07 2022] GET /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:07.961734 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-9dc62e69-82f5-401d-89a0-6879ebe0d150 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:07.962527 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-9dc62e69-82f5-401d-89a0-6879ebe0d150 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] [instance: 17705da4-6daf-4403-9461-348f62b9838b] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:07.970896 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9dc62e69-82f5-401d-89a0-6879ebe0d150 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:07.971351 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9dc62e69-82f5-401d-89a0-6879ebe0d150 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:07.972152 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9dc62e69-82f5-401d-89a0-6879ebe0d150 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:07.972609 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9dc62e69-82f5-401d-89a0-6879ebe0d150 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:08.048409 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-9dc62e69-82f5-401d-89a0-6879ebe0d150 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd204ddb1baba4bf497d25115cf76a83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6d9917fc484639a0e0793ae14496b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:08.058063 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-9dc62e69-82f5-401d-89a0-6879ebe0d150 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] 10.222.0.66 "GET /compute/v2.1/servers/17705da4-6daf-4403-9461-348f62b9838b" status: 200 len: 1427 microversion: 2.1 time: 0.101156 Jul 15 20:39:08.058856 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 174/351] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:07 2022] GET /compute/v2.1/servers/17705da4-6daf-4403-9461-348f62b9838b => generated 1427 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:08.168847 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-50fbef09-a4da-4bf8-947c-f72bc159ea49 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:08.170092 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-50fbef09-a4da-4bf8-947c-f72bc159ea49 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 48c34b54-0234-4763-a6c1-f73c3c075277] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:08.178475 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-50fbef09-a4da-4bf8-947c-f72bc159ea49 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:08.179092 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-50fbef09-a4da-4bf8-947c-f72bc159ea49 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:08.179865 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-50fbef09-a4da-4bf8-947c-f72bc159ea49 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:08.180294 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-50fbef09-a4da-4bf8-947c-f72bc159ea49 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:08.320381 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-50fbef09-a4da-4bf8-947c-f72bc159ea49 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:08.329041 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-50fbef09-a4da-4bf8-947c-f72bc159ea49 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277" status: 200 len: 1510 microversion: 2.1 time: 0.164186 Jul 15 20:39:08.330242 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 178/352] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:08 2022] GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277 => generated 1510 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:08.667622 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-00840906-f52e-4531-bfe1-23dff4ef1a3b tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:08.668836 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-00840906-f52e-4531-bfe1-23dff4ef1a3b tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 0f5cb5b0-4308-42bf-9145-9d88bd8af17c] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:08.678310 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-00840906-f52e-4531-bfe1-23dff4ef1a3b tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:08.678880 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-00840906-f52e-4531-bfe1-23dff4ef1a3b tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:08.679966 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-00840906-f52e-4531-bfe1-23dff4ef1a3b tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:08.680539 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-00840906-f52e-4531-bfe1-23dff4ef1a3b tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:08.839989 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-00840906-f52e-4531-bfe1-23dff4ef1a3b tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:08.851633 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-00840906-f52e-4531-bfe1-23dff4ef1a3b tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c" status: 200 len: 1367 microversion: 2.1 time: 0.189208 Jul 15 20:39:08.852813 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 175/353] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:08 2022] GET /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c => generated 1367 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:09.078504 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-5d94452a-0ace-49f9-abed-268eac76e32b tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:09.079145 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-5d94452a-0ace-49f9-abed-268eac76e32b tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] [instance: 17705da4-6daf-4403-9461-348f62b9838b] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:09.086308 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-5d94452a-0ace-49f9-abed-268eac76e32b tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:09.086791 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-5d94452a-0ace-49f9-abed-268eac76e32b tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:09.087745 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-5d94452a-0ace-49f9-abed-268eac76e32b tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:09.088354 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-5d94452a-0ace-49f9-abed-268eac76e32b tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:09.092852 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:09.159492 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-5d94452a-0ace-49f9-abed-268eac76e32b tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd204ddb1baba4bf497d25115cf76a83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6d9917fc484639a0e0793ae14496b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:09.167780 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-5d94452a-0ace-49f9-abed-268eac76e32b tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] 10.222.0.66 "GET /compute/v2.1/servers/17705da4-6daf-4403-9461-348f62b9838b" status: 200 len: 1427 microversion: 2.1 time: 0.094166 Jul 15 20:39:09.168665 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 179/354] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:09 2022] GET /compute/v2.1/servers/17705da4-6daf-4403-9461-348f62b9838b => generated 1427 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:39:09.347628 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-721cfd14-d131-46f1-ad90-0f77f305eb74 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:09.348164 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-721cfd14-d131-46f1-ad90-0f77f305eb74 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 48c34b54-0234-4763-a6c1-f73c3c075277] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:09.354895 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-721cfd14-d131-46f1-ad90-0f77f305eb74 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:09.355356 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-721cfd14-d131-46f1-ad90-0f77f305eb74 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:09.356153 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-721cfd14-d131-46f1-ad90-0f77f305eb74 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:09.356630 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-721cfd14-d131-46f1-ad90-0f77f305eb74 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:09.504554 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-721cfd14-d131-46f1-ad90-0f77f305eb74 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:09.512429 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-721cfd14-d131-46f1-ad90-0f77f305eb74 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277" status: 200 len: 1510 microversion: 2.1 time: 0.168973 Jul 15 20:39:09.517114 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 176/355] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:09 2022] GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277 => generated 1510 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:09.869683 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-49f4b969-feef-4460-93b0-de14dfed25f8 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:09.870365 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-49f4b969-feef-4460-93b0-de14dfed25f8 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 0f5cb5b0-4308-42bf-9145-9d88bd8af17c] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:09.877930 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-49f4b969-feef-4460-93b0-de14dfed25f8 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:09.878451 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-49f4b969-feef-4460-93b0-de14dfed25f8 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:09.879275 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-49f4b969-feef-4460-93b0-de14dfed25f8 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:09.879709 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-49f4b969-feef-4460-93b0-de14dfed25f8 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:10.098008 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-49f4b969-feef-4460-93b0-de14dfed25f8 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:10.112592 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-49f4b969-feef-4460-93b0-de14dfed25f8 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c" status: 200 len: 1367 microversion: 2.1 time: 0.246948 Jul 15 20:39:10.122581 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 180/356] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:09 2022] GET /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c => generated 1367 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:10.186308 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-221eba7d-5488-4e2e-9d8c-24c307a3f2c9 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:10.186931 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-221eba7d-5488-4e2e-9d8c-24c307a3f2c9 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] [instance: 17705da4-6daf-4403-9461-348f62b9838b] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:10.197192 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-221eba7d-5488-4e2e-9d8c-24c307a3f2c9 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:10.197655 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-221eba7d-5488-4e2e-9d8c-24c307a3f2c9 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:10.198493 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-221eba7d-5488-4e2e-9d8c-24c307a3f2c9 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:10.198933 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-221eba7d-5488-4e2e-9d8c-24c307a3f2c9 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:10.291178 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-221eba7d-5488-4e2e-9d8c-24c307a3f2c9 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd204ddb1baba4bf497d25115cf76a83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6d9917fc484639a0e0793ae14496b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:10.307332 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-221eba7d-5488-4e2e-9d8c-24c307a3f2c9 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] 10.222.0.66 "GET /compute/v2.1/servers/17705da4-6daf-4403-9461-348f62b9838b" status: 200 len: 1299 microversion: 2.1 time: 0.125034 Jul 15 20:39:10.307936 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 177/357] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:10 2022] GET /compute/v2.1/servers/17705da4-6daf-4403-9461-348f62b9838b => generated 1299 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:10.533822 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-d54a2758-af87-4b89-baf9-2799937a0add tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:10.535116 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-d54a2758-af87-4b89-baf9-2799937a0add tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 48c34b54-0234-4763-a6c1-f73c3c075277] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:10.543624 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d54a2758-af87-4b89-baf9-2799937a0add tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:10.544542 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d54a2758-af87-4b89-baf9-2799937a0add tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:10.545636 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d54a2758-af87-4b89-baf9-2799937a0add tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:10.546429 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d54a2758-af87-4b89-baf9-2799937a0add tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:10.733764 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-d54a2758-af87-4b89-baf9-2799937a0add tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:10.743080 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-d54a2758-af87-4b89-baf9-2799937a0add tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277" status: 200 len: 1510 microversion: 2.1 time: 0.215528 Jul 15 20:39:10.743829 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 181/358] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:10 2022] GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277 => generated 1510 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:11.129765 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-bd6b3f02-c5bd-485a-8d9a-9bfa33511f61 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:11.130507 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-bd6b3f02-c5bd-485a-8d9a-9bfa33511f61 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 0f5cb5b0-4308-42bf-9145-9d88bd8af17c] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:11.138670 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-bd6b3f02-c5bd-485a-8d9a-9bfa33511f61 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:11.139116 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-bd6b3f02-c5bd-485a-8d9a-9bfa33511f61 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:11.139893 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-bd6b3f02-c5bd-485a-8d9a-9bfa33511f61 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:11.140332 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-bd6b3f02-c5bd-485a-8d9a-9bfa33511f61 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:11.294084 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-bd6b3f02-c5bd-485a-8d9a-9bfa33511f61 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:11.304005 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-bd6b3f02-c5bd-485a-8d9a-9bfa33511f61 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c" status: 200 len: 1367 microversion: 2.1 time: 0.177835 Jul 15 20:39:11.305168 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 178/359] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:11 2022] GET /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:11.326723 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-319fe240-f1e8-4c71-8528-560abcec37fd tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:11.327490 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-319fe240-f1e8-4c71-8528-560abcec37fd tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] [instance: 17705da4-6daf-4403-9461-348f62b9838b] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:11.332714 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=98,nova_api:UPDATE=1 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:11.336861 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-319fe240-f1e8-4c71-8528-560abcec37fd tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:11.337341 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-319fe240-f1e8-4c71-8528-560abcec37fd tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:11.338286 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-319fe240-f1e8-4c71-8528-560abcec37fd tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:11.338730 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-319fe240-f1e8-4c71-8528-560abcec37fd tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:11.380312 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-319fe240-f1e8-4c71-8528-560abcec37fd tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:11.381022 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-319fe240-f1e8-4c71-8528-560abcec37fd tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:11.382401 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.objects.instance [None req-319fe240-f1e8-4c71-8528-560abcec37fd tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lazy-loading 'fault' on Instance uuid 17705da4-6daf-4403-9461-348f62b9838b {{(pid=124430) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 20:39:11.427443 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-319fe240-f1e8-4c71-8528-560abcec37fd tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd204ddb1baba4bf497d25115cf76a83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6d9917fc484639a0e0793ae14496b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:11.435313 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-319fe240-f1e8-4c71-8528-560abcec37fd tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] 10.222.0.66 "GET /compute/v2.1/servers/17705da4-6daf-4403-9461-348f62b9838b" status: 200 len: 1304 microversion: 2.1 time: 0.114056 Jul 15 20:39:11.448222 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 182/360] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:11 2022] GET /compute/v2.1/servers/17705da4-6daf-4403-9461-348f62b9838b => generated 1304 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:11.760812 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-7121e3b6-464e-422a-8c71-628b0fde85f4 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:11.761652 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-7121e3b6-464e-422a-8c71-628b0fde85f4 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 48c34b54-0234-4763-a6c1-f73c3c075277] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:11.770002 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7121e3b6-464e-422a-8c71-628b0fde85f4 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:11.770002 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7121e3b6-464e-422a-8c71-628b0fde85f4 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:11.770529 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7121e3b6-464e-422a-8c71-628b0fde85f4 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:11.770882 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7121e3b6-464e-422a-8c71-628b0fde85f4 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:11.914006 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-7121e3b6-464e-422a-8c71-628b0fde85f4 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:11.925586 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-7121e3b6-464e-422a-8c71-628b0fde85f4 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277" status: 200 len: 1510 microversion: 2.1 time: 0.168345 Jul 15 20:39:11.926328 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 179/361] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:11 2022] GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277 => generated 1510 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:39:12.324977 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-dd6304b4-a5e4-4531-ac42-b8f1ea158410 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:12.325761 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-dd6304b4-a5e4-4531-ac42-b8f1ea158410 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 0f5cb5b0-4308-42bf-9145-9d88bd8af17c] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:12.332507 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-dd6304b4-a5e4-4531-ac42-b8f1ea158410 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:12.333153 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-dd6304b4-a5e4-4531-ac42-b8f1ea158410 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:12.333395 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-dd6304b4-a5e4-4531-ac42-b8f1ea158410 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:12.334535 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-dd6304b4-a5e4-4531-ac42-b8f1ea158410 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:12.455995 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-47086e06-b843-4cdc-9f7a-30e7c7ee7df0 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:12.457423 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-47086e06-b843-4cdc-9f7a-30e7c7ee7df0 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] [instance: 17705da4-6daf-4403-9461-348f62b9838b] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:12.467109 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-47086e06-b843-4cdc-9f7a-30e7c7ee7df0 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:12.467920 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-47086e06-b843-4cdc-9f7a-30e7c7ee7df0 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:12.469620 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-47086e06-b843-4cdc-9f7a-30e7c7ee7df0 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:12.470319 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-47086e06-b843-4cdc-9f7a-30e7c7ee7df0 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:12.490088 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-dd6304b4-a5e4-4531-ac42-b8f1ea158410 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:12.502839 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-dd6304b4-a5e4-4531-ac42-b8f1ea158410 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c" status: 200 len: 1367 microversion: 2.1 time: 0.181493 Jul 15 20:39:12.504000 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 183/362] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:12 2022] GET /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:12.505165 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-47086e06-b843-4cdc-9f7a-30e7c7ee7df0 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:12.505830 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-47086e06-b843-4cdc-9f7a-30e7c7ee7df0 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:12.506354 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.objects.instance [None req-47086e06-b843-4cdc-9f7a-30e7c7ee7df0 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lazy-loading 'fault' on Instance uuid 17705da4-6daf-4403-9461-348f62b9838b {{(pid=124432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 20:39:12.555400 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-47086e06-b843-4cdc-9f7a-30e7c7ee7df0 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd204ddb1baba4bf497d25115cf76a83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6d9917fc484639a0e0793ae14496b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:12.564893 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-47086e06-b843-4cdc-9f7a-30e7c7ee7df0 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] 10.222.0.66 "GET /compute/v2.1/servers/17705da4-6daf-4403-9461-348f62b9838b" status: 200 len: 1304 microversion: 2.1 time: 0.112827 Jul 15 20:39:12.566236 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 180/363] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:12 2022] GET /compute/v2.1/servers/17705da4-6daf-4403-9461-348f62b9838b => generated 1304 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:12.947268 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-e2a287d3-8f37-4c3b-9943-bb553ba2bcc4 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:12.948264 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-e2a287d3-8f37-4c3b-9943-bb553ba2bcc4 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 48c34b54-0234-4763-a6c1-f73c3c075277] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:12.955664 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e2a287d3-8f37-4c3b-9943-bb553ba2bcc4 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:12.956113 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e2a287d3-8f37-4c3b-9943-bb553ba2bcc4 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:12.956939 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e2a287d3-8f37-4c3b-9943-bb553ba2bcc4 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:12.957392 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e2a287d3-8f37-4c3b-9943-bb553ba2bcc4 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:13.109438 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-e2a287d3-8f37-4c3b-9943-bb553ba2bcc4 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:13.119499 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-e2a287d3-8f37-4c3b-9943-bb553ba2bcc4 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277" status: 200 len: 1510 microversion: 2.1 time: 0.179452 Jul 15 20:39:13.131177 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 184/364] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:12 2022] GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277 => generated 1510 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:39:13.524516 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-03bbd91b-9307-489f-ba1b-f32791aa5125 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:13.525309 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-03bbd91b-9307-489f-ba1b-f32791aa5125 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 0f5cb5b0-4308-42bf-9145-9d88bd8af17c] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:13.532974 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-03bbd91b-9307-489f-ba1b-f32791aa5125 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:13.534364 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-03bbd91b-9307-489f-ba1b-f32791aa5125 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:13.535169 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-03bbd91b-9307-489f-ba1b-f32791aa5125 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:13.535620 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-03bbd91b-9307-489f-ba1b-f32791aa5125 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:13.587554 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-06cce491-5f9c-43c8-ae43-d87f5fdcd5fb tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:13.588153 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-06cce491-5f9c-43c8-ae43-d87f5fdcd5fb tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] [instance: 17705da4-6daf-4403-9461-348f62b9838b] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:13.594852 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-06cce491-5f9c-43c8-ae43-d87f5fdcd5fb tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:13.595288 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-06cce491-5f9c-43c8-ae43-d87f5fdcd5fb tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:13.596172 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-06cce491-5f9c-43c8-ae43-d87f5fdcd5fb tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:13.596496 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-06cce491-5f9c-43c8-ae43-d87f5fdcd5fb tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:13.633634 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-06cce491-5f9c-43c8-ae43-d87f5fdcd5fb tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:13.634296 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-06cce491-5f9c-43c8-ae43-d87f5fdcd5fb tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:13.634890 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.objects.instance [None req-06cce491-5f9c-43c8-ae43-d87f5fdcd5fb tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lazy-loading 'fault' on Instance uuid 17705da4-6daf-4403-9461-348f62b9838b {{(pid=124430) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 20:39:13.697094 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-06cce491-5f9c-43c8-ae43-d87f5fdcd5fb tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd204ddb1baba4bf497d25115cf76a83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6d9917fc484639a0e0793ae14496b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:13.705713 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-06cce491-5f9c-43c8-ae43-d87f5fdcd5fb tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] 10.222.0.66 "GET /compute/v2.1/servers/17705da4-6daf-4403-9461-348f62b9838b" status: 200 len: 1304 microversion: 2.1 time: 0.124842 Jul 15 20:39:13.706621 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 185/365] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:13 2022] GET /compute/v2.1/servers/17705da4-6daf-4403-9461-348f62b9838b => generated 1304 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:13.721731 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-03bbd91b-9307-489f-ba1b-f32791aa5125 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:13.729530 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-03bbd91b-9307-489f-ba1b-f32791aa5125 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c" status: 200 len: 1367 microversion: 2.1 time: 0.214199 Jul 15 20:39:13.730401 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 181/366] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:13 2022] GET /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c => generated 1367 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:14.137601 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-338dc095-6cbd-4156-9449-e16fa164ea4a tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:14.138201 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-338dc095-6cbd-4156-9449-e16fa164ea4a tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 48c34b54-0234-4763-a6c1-f73c3c075277] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:14.146376 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-338dc095-6cbd-4156-9449-e16fa164ea4a tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:14.148009 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-338dc095-6cbd-4156-9449-e16fa164ea4a tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:14.149095 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-338dc095-6cbd-4156-9449-e16fa164ea4a tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:14.150032 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-338dc095-6cbd-4156-9449-e16fa164ea4a tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:14.302147 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-338dc095-6cbd-4156-9449-e16fa164ea4a tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:14.309773 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-338dc095-6cbd-4156-9449-e16fa164ea4a tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277" status: 200 len: 1510 microversion: 2.1 time: 0.176051 Jul 15 20:39:14.310337 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 186/367] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:14 2022] GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277 => generated 1510 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:14.724529 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-ccdc9488-3165-409a-9c10-931c5fca8a53 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:14.726420 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-ccdc9488-3165-409a-9c10-931c5fca8a53 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] [instance: 17705da4-6daf-4403-9461-348f62b9838b] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:14.734220 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ccdc9488-3165-409a-9c10-931c5fca8a53 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:14.735311 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ccdc9488-3165-409a-9c10-931c5fca8a53 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:14.736334 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ccdc9488-3165-409a-9c10-931c5fca8a53 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:14.737076 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ccdc9488-3165-409a-9c10-931c5fca8a53 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:14.749241 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-3e7e328e-7c69-41de-b28a-0bc4e6583812 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:14.751433 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-3e7e328e-7c69-41de-b28a-0bc4e6583812 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 0f5cb5b0-4308-42bf-9145-9d88bd8af17c] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:14.760167 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-3e7e328e-7c69-41de-b28a-0bc4e6583812 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:14.761085 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-3e7e328e-7c69-41de-b28a-0bc4e6583812 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:14.762087 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-3e7e328e-7c69-41de-b28a-0bc4e6583812 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:14.762714 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-3e7e328e-7c69-41de-b28a-0bc4e6583812 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:14.792326 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ccdc9488-3165-409a-9c10-931c5fca8a53 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:14.793396 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ccdc9488-3165-409a-9c10-931c5fca8a53 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:14.793855 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.objects.instance [None req-ccdc9488-3165-409a-9c10-931c5fca8a53 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lazy-loading 'fault' on Instance uuid 17705da4-6daf-4403-9461-348f62b9838b {{(pid=124432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 20:39:14.867171 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-ccdc9488-3165-409a-9c10-931c5fca8a53 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd204ddb1baba4bf497d25115cf76a83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6d9917fc484639a0e0793ae14496b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:14.883589 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-ccdc9488-3165-409a-9c10-931c5fca8a53 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] 10.222.0.66 "GET /compute/v2.1/servers/17705da4-6daf-4403-9461-348f62b9838b" status: 200 len: 1304 microversion: 2.1 time: 0.162851 Jul 15 20:39:14.884170 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 182/368] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:14 2022] GET /compute/v2.1/servers/17705da4-6daf-4403-9461-348f62b9838b => generated 1304 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:14.949480 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-3e7e328e-7c69-41de-b28a-0bc4e6583812 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:14.960854 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-3e7e328e-7c69-41de-b28a-0bc4e6583812 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c" status: 200 len: 1367 microversion: 2.1 time: 0.215913 Jul 15 20:39:14.961585 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 187/369] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:14 2022] GET /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c => generated 1367 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:15.091201 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-0d8f78c6-b84b-413c-9ab8-ed027267caea req-4223992a-0742-43fd-912a-b0473eea2fd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f5cb5b0-4308-42bf-9145-9d88bd8af17c", "name": "network-vif-plugged", "status": "completed", "tag": "1f2f6332-7e5b-4cf3-9154-434d47672d10"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:39:15.101765 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-0d8f78c6-b84b-413c-9ab8-ed027267caea req-4223992a-0742-43fd-912a-b0473eea2fd2 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:15.102655 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-0d8f78c6-b84b-413c-9ab8-ed027267caea req-4223992a-0742-43fd-912a-b0473eea2fd2 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:15.126590 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-0d8f78c6-b84b-413c-9ab8-ed027267caea req-4223992a-0742-43fd-912a-b0473eea2fd2 service nova] Creating event network-vif-plugged:1f2f6332-7e5b-4cf3-9154-434d47672d10 for instance 0f5cb5b0-4308-42bf-9145-9d88bd8af17c on hv-cinder-79987 Jul 15 20:39:15.142628 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-0d8f78c6-b84b-413c-9ab8-ed027267caea req-4223992a-0742-43fd-912a-b0473eea2fd2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055340 Jul 15 20:39:15.143644 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 183/370] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:39:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:39:15.327117 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-f1a8f15c-a0a2-4f01-825f-87ff6031a212 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:15.327649 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-f1a8f15c-a0a2-4f01-825f-87ff6031a212 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 48c34b54-0234-4763-a6c1-f73c3c075277] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:15.334016 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-f1a8f15c-a0a2-4f01-825f-87ff6031a212 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:15.334465 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-f1a8f15c-a0a2-4f01-825f-87ff6031a212 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:15.335371 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-f1a8f15c-a0a2-4f01-825f-87ff6031a212 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:15.335805 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-f1a8f15c-a0a2-4f01-825f-87ff6031a212 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:15.507352 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-f1a8f15c-a0a2-4f01-825f-87ff6031a212 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:15.515983 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-f1a8f15c-a0a2-4f01-825f-87ff6031a212 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277" status: 200 len: 1510 microversion: 2.1 time: 0.192109 Jul 15 20:39:15.516994 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 188/371] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:15 2022] GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277 => generated 1510 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:15.908784 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-356588c2-e84c-4251-87d7-0a7ade37e66c tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:15.910136 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-356588c2-e84c-4251-87d7-0a7ade37e66c tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] [instance: 17705da4-6daf-4403-9461-348f62b9838b] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:15.917545 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-356588c2-e84c-4251-87d7-0a7ade37e66c tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:15.917979 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-356588c2-e84c-4251-87d7-0a7ade37e66c tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:15.918912 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-356588c2-e84c-4251-87d7-0a7ade37e66c tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:15.919336 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-356588c2-e84c-4251-87d7-0a7ade37e66c tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:15.958762 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-356588c2-e84c-4251-87d7-0a7ade37e66c tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:15.959555 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-356588c2-e84c-4251-87d7-0a7ade37e66c tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:15.960150 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.objects.instance [None req-356588c2-e84c-4251-87d7-0a7ade37e66c tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lazy-loading 'fault' on Instance uuid 17705da4-6daf-4403-9461-348f62b9838b {{(pid=124432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 20:39:15.978453 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-a4e3a7ac-21c8-44b4-8cee-ede3b4f81bc2 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:15.979837 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-a4e3a7ac-21c8-44b4-8cee-ede3b4f81bc2 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 0f5cb5b0-4308-42bf-9145-9d88bd8af17c] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:15.989141 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-a4e3a7ac-21c8-44b4-8cee-ede3b4f81bc2 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:15.990017 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-a4e3a7ac-21c8-44b4-8cee-ede3b4f81bc2 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:15.991034 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-a4e3a7ac-21c8-44b4-8cee-ede3b4f81bc2 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:15.991668 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-a4e3a7ac-21c8-44b4-8cee-ede3b4f81bc2 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:16.010693 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-356588c2-e84c-4251-87d7-0a7ade37e66c tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd204ddb1baba4bf497d25115cf76a83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6d9917fc484639a0e0793ae14496b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:16.018822 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-356588c2-e84c-4251-87d7-0a7ade37e66c tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] 10.222.0.66 "GET /compute/v2.1/servers/17705da4-6daf-4403-9461-348f62b9838b" status: 200 len: 1304 microversion: 2.1 time: 0.119263 Jul 15 20:39:16.030802 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 184/372] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:15 2022] GET /compute/v2.1/servers/17705da4-6daf-4403-9461-348f62b9838b => generated 1304 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:16.150586 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-a4e3a7ac-21c8-44b4-8cee-ede3b4f81bc2 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:16.162522 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-a4e3a7ac-21c8-44b4-8cee-ede3b4f81bc2 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c" status: 200 len: 1367 microversion: 2.1 time: 0.188025 Jul 15 20:39:16.165479 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 189/373] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:15 2022] GET /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c => generated 1367 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:16.534677 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-ab51d46c-4d4d-4f82-93f6-30ada68eb3b9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:16.535295 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-ab51d46c-4d4d-4f82-93f6-30ada68eb3b9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 48c34b54-0234-4763-a6c1-f73c3c075277] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:16.541399 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ab51d46c-4d4d-4f82-93f6-30ada68eb3b9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:16.542120 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ab51d46c-4d4d-4f82-93f6-30ada68eb3b9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:16.542961 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ab51d46c-4d4d-4f82-93f6-30ada68eb3b9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:16.543351 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ab51d46c-4d4d-4f82-93f6-30ada68eb3b9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:16.677759 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-ab51d46c-4d4d-4f82-93f6-30ada68eb3b9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:16.685344 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-ab51d46c-4d4d-4f82-93f6-30ada68eb3b9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277" status: 200 len: 1510 microversion: 2.1 time: 0.155270 Jul 15 20:39:16.685940 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 185/374] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:16 2022] GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277 => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:39:17.038209 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-c48b203e-3e60-4f87-a7c3-dcf1fcb5a774 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:17.038819 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-c48b203e-3e60-4f87-a7c3-dcf1fcb5a774 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] [instance: 17705da4-6daf-4403-9461-348f62b9838b] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:17.045628 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c48b203e-3e60-4f87-a7c3-dcf1fcb5a774 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:17.046021 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c48b203e-3e60-4f87-a7c3-dcf1fcb5a774 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:17.046920 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c48b203e-3e60-4f87-a7c3-dcf1fcb5a774 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:17.047519 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c48b203e-3e60-4f87-a7c3-dcf1fcb5a774 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:17.079593 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c48b203e-3e60-4f87-a7c3-dcf1fcb5a774 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:17.080039 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c48b203e-3e60-4f87-a7c3-dcf1fcb5a774 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:17.080507 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.objects.instance [None req-c48b203e-3e60-4f87-a7c3-dcf1fcb5a774 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lazy-loading 'fault' on Instance uuid 17705da4-6daf-4403-9461-348f62b9838b {{(pid=124430) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 20:39:17.120067 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-c48b203e-3e60-4f87-a7c3-dcf1fcb5a774 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd204ddb1baba4bf497d25115cf76a83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6d9917fc484639a0e0793ae14496b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:17.127657 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-c48b203e-3e60-4f87-a7c3-dcf1fcb5a774 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] 10.222.0.66 "GET /compute/v2.1/servers/17705da4-6daf-4403-9461-348f62b9838b" status: 200 len: 1304 microversion: 2.1 time: 0.093337 Jul 15 20:39:17.128218 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 190/375] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:17 2022] GET /compute/v2.1/servers/17705da4-6daf-4403-9461-348f62b9838b => generated 1304 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:17.179871 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-b7506ef7-c11b-438c-b1e8-71275caf8165 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:17.180519 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-b7506ef7-c11b-438c-b1e8-71275caf8165 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 0f5cb5b0-4308-42bf-9145-9d88bd8af17c] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:17.187023 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b7506ef7-c11b-438c-b1e8-71275caf8165 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:17.187599 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b7506ef7-c11b-438c-b1e8-71275caf8165 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:17.188363 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b7506ef7-c11b-438c-b1e8-71275caf8165 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:17.188820 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b7506ef7-c11b-438c-b1e8-71275caf8165 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:17.322363 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-b7506ef7-c11b-438c-b1e8-71275caf8165 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:17.325873 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell1:SELECT=100 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:17.331311 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-b7506ef7-c11b-438c-b1e8-71275caf8165 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c" status: 200 len: 1367 microversion: 2.1 time: 0.155274 Jul 15 20:39:17.331868 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 186/376] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:17 2022] GET /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:17.702244 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-07658aea-7413-478e-ac0e-28f14fc86b5d tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:17.703497 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-07658aea-7413-478e-ac0e-28f14fc86b5d tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 48c34b54-0234-4763-a6c1-f73c3c075277] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:17.709727 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-07658aea-7413-478e-ac0e-28f14fc86b5d tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:17.710166 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-07658aea-7413-478e-ac0e-28f14fc86b5d tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:17.710911 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-07658aea-7413-478e-ac0e-28f14fc86b5d tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:17.711339 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-07658aea-7413-478e-ac0e-28f14fc86b5d tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:17.846821 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-07658aea-7413-478e-ac0e-28f14fc86b5d tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:17.854960 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-07658aea-7413-478e-ac0e-28f14fc86b5d tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277" status: 200 len: 1510 microversion: 2.1 time: 0.156362 Jul 15 20:39:17.855704 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 191/377] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:17 2022] GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277 => generated 1510 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:18.145531 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-84eeb7e7-7a6a-4051-ad18-cf6ea89123b4 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:18.146058 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-84eeb7e7-7a6a-4051-ad18-cf6ea89123b4 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] [instance: 17705da4-6daf-4403-9461-348f62b9838b] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:18.152202 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-84eeb7e7-7a6a-4051-ad18-cf6ea89123b4 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:18.152679 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-84eeb7e7-7a6a-4051-ad18-cf6ea89123b4 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:18.153445 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-84eeb7e7-7a6a-4051-ad18-cf6ea89123b4 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:18.153877 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-84eeb7e7-7a6a-4051-ad18-cf6ea89123b4 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:18.186967 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-84eeb7e7-7a6a-4051-ad18-cf6ea89123b4 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:18.187675 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-84eeb7e7-7a6a-4051-ad18-cf6ea89123b4 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:18.188190 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.objects.instance [None req-84eeb7e7-7a6a-4051-ad18-cf6ea89123b4 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lazy-loading 'fault' on Instance uuid 17705da4-6daf-4403-9461-348f62b9838b {{(pid=124432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 20:39:18.228899 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-84eeb7e7-7a6a-4051-ad18-cf6ea89123b4 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd204ddb1baba4bf497d25115cf76a83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6d9917fc484639a0e0793ae14496b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:18.237000 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-84eeb7e7-7a6a-4051-ad18-cf6ea89123b4 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] 10.222.0.66 "GET /compute/v2.1/servers/17705da4-6daf-4403-9461-348f62b9838b" status: 200 len: 1304 microversion: 2.1 time: 0.096318 Jul 15 20:39:18.237566 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 187/378] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:18 2022] GET /compute/v2.1/servers/17705da4-6daf-4403-9461-348f62b9838b => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:18.348058 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-2920516c-cdd6-4445-a3d1-1362e3da4556 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:18.348778 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-2920516c-cdd6-4445-a3d1-1362e3da4556 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 0f5cb5b0-4308-42bf-9145-9d88bd8af17c] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:18.355364 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-2920516c-cdd6-4445-a3d1-1362e3da4556 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:18.355908 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-2920516c-cdd6-4445-a3d1-1362e3da4556 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:18.356707 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-2920516c-cdd6-4445-a3d1-1362e3da4556 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:18.357148 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-2920516c-cdd6-4445-a3d1-1362e3da4556 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:18.507082 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-2920516c-cdd6-4445-a3d1-1362e3da4556 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:18.514717 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-2920516c-cdd6-4445-a3d1-1362e3da4556 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c" status: 200 len: 1367 microversion: 2.1 time: 0.171433 Jul 15 20:39:18.515868 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 192/379] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:18 2022] GET /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:18.873881 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-f33bc72b-c178-4cb4-ae64-eb768feb8401 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:18.875126 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-f33bc72b-c178-4cb4-ae64-eb768feb8401 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 48c34b54-0234-4763-a6c1-f73c3c075277] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:18.882386 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f33bc72b-c178-4cb4-ae64-eb768feb8401 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:18.882906 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f33bc72b-c178-4cb4-ae64-eb768feb8401 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:18.883752 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f33bc72b-c178-4cb4-ae64-eb768feb8401 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:18.884258 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f33bc72b-c178-4cb4-ae64-eb768feb8401 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:19.017289 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-f33bc72b-c178-4cb4-ae64-eb768feb8401 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:19.024796 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-f33bc72b-c178-4cb4-ae64-eb768feb8401 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277" status: 200 len: 1516 microversion: 2.1 time: 0.155993 Jul 15 20:39:19.025365 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 188/380] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:18 2022] GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:19.264643 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-609c006e-3243-4db5-ba17-f99cd22b4927 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:19.265968 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-609c006e-3243-4db5-ba17-f99cd22b4927 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] [instance: 17705da4-6daf-4403-9461-348f62b9838b] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:19.272536 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-609c006e-3243-4db5-ba17-f99cd22b4927 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:19.273004 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-609c006e-3243-4db5-ba17-f99cd22b4927 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:19.273860 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-609c006e-3243-4db5-ba17-f99cd22b4927 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:19.274296 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-609c006e-3243-4db5-ba17-f99cd22b4927 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:19.288335 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.wsgi [None req-609c006e-3243-4db5-ba17-f99cd22b4927 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] HTTP exception thrown: Instance 17705da4-6daf-4403-9461-348f62b9838b could not be found. Jul 15 20:39:19.290039 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-609c006e-3243-4db5-ba17-f99cd22b4927 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Request method failure captured: Jul 15 20:39:19.290039 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: request: GET /compute/v2.1/servers/17705da4-6daf-4403-9461-348f62b9838b HTTP/1.1 Jul 15 20:39:19.290039 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Accept: application/json Jul 15 20:39:19.290039 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Accept-Encoding: identity Jul 15 20:39:19.290039 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Connection: close Jul 15 20:39:19.290039 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Content-Length: 0 Jul 15 20:39:19.290039 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Content-Type: application/json Jul 15 20:39:19.290039 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Host: 10.222.0.66 Jul 15 20:39:19.290039 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Openstack-System-Scope: None Jul 15 20:39:19.290039 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: User-Agent: python-urllib3/1.26.9 Jul 15 20:39:19.290039 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Auth-Token: gAAAAABi0dBM1JySUs4QcrDRWmf4430466lbRBEiR9uJyL2CLGK1eSNsZKBrz5pL0ZMMEVDR69LFeSw2M8tS1A2_UmFARA4hzJ6GZiab7OF8uJWTT0K4P7aUjTerihHmyPqzl7QUSRYfGQ4GBNDlS7uQJjP6ZRNoL6Do_XBhnkCRFAhoRbB8Ot4 Jul 15 20:39:19.290039 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Domain-Id: None Jul 15 20:39:19.290039 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Domain-Name: None Jul 15 20:39:19.290039 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Identity-Status: Confirmed Jul 15 20:39:19.290039 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Is-Admin-Project: True Jul 15 20:39:19.290039 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Domain-Id: default Jul 15 20:39:19.290039 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Domain-Name: Default Jul 15 20:39:19.290039 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Id: 5c6d9917fc484639a0e0793ae14496b2 Jul 15 20:39:19.290039 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Name: tempest-VolumesNegativeTest-1063924734 Jul 15 20:39:19.290039 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Role: member,reader Jul 15 20:39:19.290039 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Roles: member,reader Jul 15 20:39:19.291390 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5c6d9917fc484639a0e0793ae14496b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_5c6d9917fc484639a0e0793ae14496b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5c6d9917fc484639a0e0793ae14496b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/5c6d9917fc484639a0e0793ae14496b2"}]}] Jul 15 20:39:19.291390 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant: tempest-VolumesNegativeTest-1063924734 Jul 15 20:39:19.291390 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant-Id: 5c6d9917fc484639a0e0793ae14496b2 Jul 15 20:39:19.291390 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant-Name: tempest-VolumesNegativeTest-1063924734 Jul 15 20:39:19.291390 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User: tempest-VolumesNegativeTest-1063924734-project Jul 15 20:39:19.291390 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Domain-Id: default Jul 15 20:39:19.291390 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Domain-Name: Default Jul 15 20:39:19.291390 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Id: d204ddb1baba4bf497d25115cf76a83b Jul 15 20:39:19.291390 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Name: tempest-VolumesNegativeTest-1063924734-project Jul 15 20:39:19.291390 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: method: > Jul 15 20:39:19.291390 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: exception: Instance 17705da4-6daf-4403-9461-348f62b9838b could not be found. Jul 15 20:39:19.291390 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: action_args: {'id': '17705da4-6daf-4403-9461-348f62b9838b'} Jul 15 20:39:19.293258 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 20:39:19.293258 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:39:19.293258 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 20:39:19.293258 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 20:39:19.293258 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 20:39:19.293258 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 20:39:19.293258 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 20:39:19.293258 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 20:39:19.293258 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 20:39:19.293258 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 20:39:19.293258 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17705da4-6daf-4403-9461-348f62b9838b could not be found. Jul 15 20:39:19.293258 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:39:19.293258 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:39:19.293258 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:39:19.293258 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:39:19.293258 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:39:19.293258 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:39:19.293258 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 20:39:19.293258 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 20:39:19.293258 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 20:39:19.294575 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 20:39:19.294575 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 20:39:19.294575 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 20:39:19.294575 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 20:39:19.294575 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 20:39:19.294575 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 20:39:19.294575 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 20:39:19.294575 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17705da4-6daf-4403-9461-348f62b9838b could not be found. Jul 15 20:39:19.294575 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:39:19.294575 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:39:19.294575 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:39:19.294575 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:39:19.294575 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:39:19.294575 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:39:19.294575 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 20:39:19.294575 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 20:39:19.294575 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17705da4-6daf-4403-9461-348f62b9838b could not be found. Jul 15 20:39:19.294575 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:39:19.295659 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-609c006e-3243-4db5-ba17-f99cd22b4927 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] Returning 404 to user: Instance 17705da4-6daf-4403-9461-348f62b9838b could not be found. {{(pid=124430) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 20:39:19.295659 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-609c006e-3243-4db5-ba17-f99cd22b4927 tempest-VolumesNegativeTest-1063924734 tempest-VolumesNegativeTest-1063924734-project] 10.222.0.66 "GET /compute/v2.1/servers/17705da4-6daf-4403-9461-348f62b9838b" status: 404 len: 111 microversion: 2.1 time: 0.042105 Jul 15 20:39:19.295659 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 193/381] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:19 2022] GET /compute/v2.1/servers/17705da4-6daf-4403-9461-348f62b9838b => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 20:39:19.532553 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-72c83e3c-9aea-4070-929c-43a47900b3f2 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:19.533166 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-72c83e3c-9aea-4070-929c-43a47900b3f2 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 0f5cb5b0-4308-42bf-9145-9d88bd8af17c] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:19.540706 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-72c83e3c-9aea-4070-929c-43a47900b3f2 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:19.541160 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-72c83e3c-9aea-4070-929c-43a47900b3f2 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:19.542200 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-72c83e3c-9aea-4070-929c-43a47900b3f2 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:19.542632 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-72c83e3c-9aea-4070-929c-43a47900b3f2 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:19.681269 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-72c83e3c-9aea-4070-929c-43a47900b3f2 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:19.688975 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-72c83e3c-9aea-4070-929c-43a47900b3f2 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c" status: 200 len: 1367 microversion: 2.1 time: 0.160295 Jul 15 20:39:19.689569 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 189/382] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:19 2022] GET /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:20.399530 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-cbccdf81-6c60-463e-bbd1-a00981c53a38 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Action: 'create', calling method: .version_select at 0x7ff51835f0d0>, body: {"keypair": {"name": "tempest-keypair-1818393167", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNea30rJB9blDKjhRYY25QT1bq9y0T8Y4k5bFGAX2vNoMkauY+0BuklbbfWc0E6726tqBu6OnG4flU7oBdZ/vckw+wcm+IlS8zZg6IQo2kIHCfEdTBn5WWl/x8u6zfjX7Q=="}} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:39:20.414853 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.quota [None req-cbccdf81-6c60-463e-bbd1-a00981c53a38 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Getting quotas for project 0395d91380b34e968d7e39be3bc88b0f. Resources: {'key_pairs'} {{(pid=124430) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 20:39:20.420677 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.quota [None req-cbccdf81-6c60-463e-bbd1-a00981c53a38 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Getting quotas for user e13d5d7068e348248387b512c55dec5e and project 0395d91380b34e968d7e39be3bc88b0f. Resources: {'key_pairs'} {{(pid=124430) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 20:39:20.453456 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-cbccdf81-6c60-463e-bbd1-a00981c53a38 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.057580 Jul 15 20:39:20.454160 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 194/383] 10.222.0.66 () {60 vars in 1158 bytes} [Fri Jul 15 20:39:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:39:20.705479 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-2c3ba31d-8f85-4b24-b181-f4351d7babc7 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:20.706186 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-2c3ba31d-8f85-4b24-b181-f4351d7babc7 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 0f5cb5b0-4308-42bf-9145-9d88bd8af17c] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:20.726115 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2c3ba31d-8f85-4b24-b181-f4351d7babc7 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:20.727211 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2c3ba31d-8f85-4b24-b181-f4351d7babc7 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:20.728235 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2c3ba31d-8f85-4b24-b181-f4351d7babc7 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:20.737038 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2c3ba31d-8f85-4b24-b181-f4351d7babc7 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:20.957745 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-2c3ba31d-8f85-4b24-b181-f4351d7babc7 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:20.965275 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-2c3ba31d-8f85-4b24-b181-f4351d7babc7 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c" status: 200 len: 1367 microversion: 2.1 time: 0.264203 Jul 15 20:39:20.966484 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 190/384] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:20 2022] GET /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c => generated 1367 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:21.984266 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-dc315272-7572-4b63-b4ab-7a9433180439 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:21.985135 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-dc315272-7572-4b63-b4ab-7a9433180439 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 0f5cb5b0-4308-42bf-9145-9d88bd8af17c] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:22.001098 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-dc315272-7572-4b63-b4ab-7a9433180439 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:22.001574 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-dc315272-7572-4b63-b4ab-7a9433180439 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:22.002353 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-dc315272-7572-4b63-b4ab-7a9433180439 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:22.002787 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-dc315272-7572-4b63-b4ab-7a9433180439 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:22.078518 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-d130caf9-d0ff-43f5-91bc-6bc56a3c5b59 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-455445307", "imageRef": "a759604a-67e3-4c79-b848-5d03d936d7a0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dadb3a1f-a806-41dc-8315-352bd978366a"}], "security_groups": [{"name": "tempest-securitygroup--1818138576"}], "key_name": "tempest-keypair-1818393167", "user_data": "}} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:39:22.250632 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-dc315272-7572-4b63-b4ab-7a9433180439 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:22.259198 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.network.neutron [None req-d130caf9-d0ff-43f5-91bc-6bc56a3c5b59 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] validate_networks() for [('dadb3a1f-a806-41dc-8315-352bd978366a', None, None, None, None, None)] {{(pid=124432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 20:39:22.267575 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-dc315272-7572-4b63-b4ab-7a9433180439 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c" status: 200 len: 1557 microversion: 2.1 time: 0.288217 Jul 15 20:39:22.268148 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 195/385] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:21 2022] GET /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c => generated 1557 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:22.272945 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-8ce365fe-d492-4ca1-8861-4ffd521837f2 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:22.273422 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-8ce365fe-d492-4ca1-8861-4ffd521837f2 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] [instance: 0d0462a7-7852-48bd-80ae-c0f1a5a93dfc] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:22.286977 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8ce365fe-d492-4ca1-8861-4ffd521837f2 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:22.287576 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8ce365fe-d492-4ca1-8861-4ffd521837f2 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:22.288699 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8ce365fe-d492-4ca1-8861-4ffd521837f2 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:22.289202 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8ce365fe-d492-4ca1-8861-4ffd521837f2 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:22.362100 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_cell1:SELECT=100 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:22.478784 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.objects.instance [None req-8ce365fe-d492-4ca1-8861-4ffd521837f2 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lazy-loading 'services' on Instance uuid 0d0462a7-7852-48bd-80ae-c0f1a5a93dfc {{(pid=124430) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 20:39:22.618166 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-8ce365fe-d492-4ca1-8861-4ffd521837f2 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] 10.222.0.66 "DELETE /compute/v2.1/servers/0d0462a7-7852-48bd-80ae-c0f1a5a93dfc/os-volume_attachments/255742d1-5fd0-417a-8160-d607f99cc9be" status: 202 len: 0 microversion: 2.1 time: 0.348763 Jul 15 20:39:22.618800 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 196/386] 10.222.0.66 () {58 vars in 1415 bytes} [Fri Jul 15 20:39:22 2022] DELETE /compute/v2.1/servers/0d0462a7-7852-48bd-80ae-c0f1a5a93dfc/os-volume_attachments/255742d1-5fd0-417a-8160-d607f99cc9be => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 20:39:22.636794 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-c7de8832-0547-4772-94a0-2343cc93f58d tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:22.639103 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-c7de8832-0547-4772-94a0-2343cc93f58d tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 0f5cb5b0-4308-42bf-9145-9d88bd8af17c] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:22.654905 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c7de8832-0547-4772-94a0-2343cc93f58d tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:22.659296 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c7de8832-0547-4772-94a0-2343cc93f58d tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:22.662781 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c7de8832-0547-4772-94a0-2343cc93f58d tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:22.663248 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c7de8832-0547-4772-94a0-2343cc93f58d tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:22.747566 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-d130caf9-d0ff-43f5-91bc-6bc56a3c5b59 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Flavor limits 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 20:39:22.748251 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-d130caf9-d0ff-43f5-91bc-6bc56a3c5b59 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Image limits 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 20:39:22.748767 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-d130caf9-d0ff-43f5-91bc-6bc56a3c5b59 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Flavor pref 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 20:39:22.749253 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-d130caf9-d0ff-43f5-91bc-6bc56a3c5b59 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Image pref 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 20:39:22.750279 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-d130caf9-d0ff-43f5-91bc-6bc56a3c5b59 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 20:39:22.760001 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d130caf9-d0ff-43f5-91bc-6bc56a3c5b59 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:22.760767 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d130caf9-d0ff-43f5-91bc-6bc56a3c5b59 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:22.761852 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d130caf9-d0ff-43f5-91bc-6bc56a3c5b59 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:22.762285 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d130caf9-d0ff-43f5-91bc-6bc56a3c5b59 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:22.780302 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-d130caf9-d0ff-43f5-91bc-6bc56a3c5b59 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Getting quotas for project 0395d91380b34e968d7e39be3bc88b0f. Resources: {'instances', 'ram', 'cores'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 20:39:22.784619 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-d130caf9-d0ff-43f5-91bc-6bc56a3c5b59 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Getting quotas for user e13d5d7068e348248387b512c55dec5e and project 0395d91380b34e968d7e39be3bc88b0f. Resources: {'instances', 'ram', 'cores'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 20:39:22.792916 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-c7de8832-0547-4772-94a0-2343cc93f58d tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.172890 Jul 15 20:39:22.797632 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-d130caf9-d0ff-43f5-91bc-6bc56a3c5b59 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Going to run 1 instances... {{(pid=124432) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 20:39:22.800134 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 197/387] 10.222.0.66 () {58 vars in 1274 bytes} [Fri Jul 15 20:39:22 2022] GET /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c/os-interface => generated 284 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:39:22.800244 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-d130caf9-d0ff-43f5-91bc-6bc56a3c5b59 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 943a9a49-4fcd-46a5-b444-1a94f490ae2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a759604a-67e3-4c79-b848-5d03d936d7a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 20:39:22.853353 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-d130caf9-d0ff-43f5-91bc-6bc56a3c5b59 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.779782 Jul 15 20:39:22.868190 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 191/388] 10.222.0.66 () {60 vars in 1146 bytes} [Fri Jul 15 20:39:22 2022] POST /compute/v2.1/servers => generated 409 bytes in 795 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 20:39:22.885006 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-da7c6fa9-942c-4e02-b17c-2245fa885bf1 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:22.885629 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-da7c6fa9-942c-4e02-b17c-2245fa885bf1 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 943a9a49-4fcd-46a5-b444-1a94f490ae2e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:23.191261 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-da7c6fa9-942c-4e02-b17c-2245fa885bf1 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:23.200314 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-da7c6fa9-942c-4e02-b17c-2245fa885bf1 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e" status: 200 len: 1245 microversion: 2.1 time: 0.325839 Jul 15 20:39:23.201380 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 198/389] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:22 2022] GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e => generated 1245 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:23.751568 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-9cb53385-1e37-4cd3-a5b2-35e4f47ad281 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:23.752294 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-9cb53385-1e37-4cd3-a5b2-35e4f47ad281 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] [instance: 0d0462a7-7852-48bd-80ae-c0f1a5a93dfc] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:23.760612 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9cb53385-1e37-4cd3-a5b2-35e4f47ad281 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:23.761414 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9cb53385-1e37-4cd3-a5b2-35e4f47ad281 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:23.762581 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9cb53385-1e37-4cd3-a5b2-35e4f47ad281 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:23.763186 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9cb53385-1e37-4cd3-a5b2-35e4f47ad281 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:23.794506 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-9cb53385-1e37-4cd3-a5b2-35e4f47ad281 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] [instance: 0d0462a7-7852-48bd-80ae-c0f1a5a93dfc] Going to try to terminate instance {{(pid=124432) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 20:39:23.886169 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-9cb53385-1e37-4cd3-a5b2-35e4f47ad281 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] 10.222.0.66 "DELETE /compute/v2.1/servers/0d0462a7-7852-48bd-80ae-c0f1a5a93dfc" status: 204 len: 0 microversion: 2.1 time: 0.138426 Jul 15 20:39:23.887109 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 192/390] 10.222.0.66 () {58 vars in 1238 bytes} [Fri Jul 15 20:39:23 2022] DELETE /compute/v2.1/servers/0d0462a7-7852-48bd-80ae-c0f1a5a93dfc => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 20:39:23.894964 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-d48168b4-739e-47c6-bc88-9f94100b75ff tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:23.895578 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-d48168b4-739e-47c6-bc88-9f94100b75ff tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] [instance: 0d0462a7-7852-48bd-80ae-c0f1a5a93dfc] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:23.901822 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d48168b4-739e-47c6-bc88-9f94100b75ff tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:23.902274 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d48168b4-739e-47c6-bc88-9f94100b75ff tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:23.903047 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d48168b4-739e-47c6-bc88-9f94100b75ff tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:23.903479 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d48168b4-739e-47c6-bc88-9f94100b75ff tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:24.135677 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-d48168b4-739e-47c6-bc88-9f94100b75ff tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145cee1016d349ceb93323a170bc957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f9e0f8edb42848965b3c6141e88d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:24.144622 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-d48168b4-739e-47c6-bc88-9f94100b75ff tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] 10.222.0.66 "GET /compute/v2.1/servers/0d0462a7-7852-48bd-80ae-c0f1a5a93dfc" status: 200 len: 1514 microversion: 2.1 time: 0.253364 Jul 15 20:39:24.145193 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 199/391] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:23 2022] GET /compute/v2.1/servers/0d0462a7-7852-48bd-80ae-c0f1a5a93dfc => generated 1514 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:24.219209 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-0ba54bd9-c272-49e3-84ac-c70dc9673968 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:24.220421 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-0ba54bd9-c272-49e3-84ac-c70dc9673968 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 943a9a49-4fcd-46a5-b444-1a94f490ae2e] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:24.228321 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0ba54bd9-c272-49e3-84ac-c70dc9673968 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:24.228812 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0ba54bd9-c272-49e3-84ac-c70dc9673968 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:24.229653 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0ba54bd9-c272-49e3-84ac-c70dc9673968 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:24.230086 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0ba54bd9-c272-49e3-84ac-c70dc9673968 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:24.334039 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-0ba54bd9-c272-49e3-84ac-c70dc9673968 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:24.345574 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-0ba54bd9-c272-49e3-84ac-c70dc9673968 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e" status: 200 len: 1305 microversion: 2.1 time: 0.130492 Jul 15 20:39:24.346529 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 193/392] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:24 2022] GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e => generated 1305 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:24.353875 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [req-3f4ac8ea-0770-4fff-8ffe-b89eb9383e13 req-c06f3ead-07b6-4bd0-8658-10c3f9e86816 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f5cb5b0-4308-42bf-9145-9d88bd8af17c", "tag": "1f2f6332-7e5b-4cf3-9154-434d47672d10"}]} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:39:24.362866 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-3f4ac8ea-0770-4fff-8ffe-b89eb9383e13 req-c06f3ead-07b6-4bd0-8658-10c3f9e86816 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:24.363564 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-3f4ac8ea-0770-4fff-8ffe-b89eb9383e13 req-c06f3ead-07b6-4bd0-8658-10c3f9e86816 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:24.376837 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.compute.server_external_events [req-3f4ac8ea-0770-4fff-8ffe-b89eb9383e13 req-c06f3ead-07b6-4bd0-8658-10c3f9e86816 service nova] Creating event network-changed:1f2f6332-7e5b-4cf3-9154-434d47672d10 for instance 0f5cb5b0-4308-42bf-9145-9d88bd8af17c on hv-cinder-79987 Jul 15 20:39:24.386060 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [req-3f4ac8ea-0770-4fff-8ffe-b89eb9383e13 req-c06f3ead-07b6-4bd0-8658-10c3f9e86816 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035683 Jul 15 20:39:24.386652 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 200/393] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:39:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 20:39:25.163686 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-93fe31a5-d953-470f-b1ba-30af8c1d28cc tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:25.165299 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-93fe31a5-d953-470f-b1ba-30af8c1d28cc tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] [instance: 0d0462a7-7852-48bd-80ae-c0f1a5a93dfc] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:25.173575 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-93fe31a5-d953-470f-b1ba-30af8c1d28cc tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:25.174032 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-93fe31a5-d953-470f-b1ba-30af8c1d28cc tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:25.174826 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-93fe31a5-d953-470f-b1ba-30af8c1d28cc tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:25.175256 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-93fe31a5-d953-470f-b1ba-30af8c1d28cc tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:25.341923 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-93fe31a5-d953-470f-b1ba-30af8c1d28cc tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145cee1016d349ceb93323a170bc957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f9e0f8edb42848965b3c6141e88d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:25.351287 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-93fe31a5-d953-470f-b1ba-30af8c1d28cc tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] 10.222.0.66 "GET /compute/v2.1/servers/0d0462a7-7852-48bd-80ae-c0f1a5a93dfc" status: 200 len: 1514 microversion: 2.1 time: 0.192478 Jul 15 20:39:25.352230 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 194/394] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:25 2022] GET /compute/v2.1/servers/0d0462a7-7852-48bd-80ae-c0f1a5a93dfc => generated 1514 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:25.365313 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-2c979d16-5bc4-4b14-94a7-b1a6bb5644c9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:25.366478 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-2c979d16-5bc4-4b14-94a7-b1a6bb5644c9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 943a9a49-4fcd-46a5-b444-1a94f490ae2e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:25.376019 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-2c979d16-5bc4-4b14-94a7-b1a6bb5644c9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:25.376759 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-2c979d16-5bc4-4b14-94a7-b1a6bb5644c9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:25.378384 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-2c979d16-5bc4-4b14-94a7-b1a6bb5644c9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:25.378827 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-2c979d16-5bc4-4b14-94a7-b1a6bb5644c9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:25.482213 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-2c979d16-5bc4-4b14-94a7-b1a6bb5644c9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:25.491376 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-2c979d16-5bc4-4b14-94a7-b1a6bb5644c9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e" status: 200 len: 1305 microversion: 2.1 time: 0.131101 Jul 15 20:39:25.492259 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 201/395] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:25 2022] GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e => generated 1305 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:39:26.376686 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-179067cc-3767-46e7-988f-5692ffcd98f7 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:26.379728 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-179067cc-3767-46e7-988f-5692ffcd98f7 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] [instance: 0d0462a7-7852-48bd-80ae-c0f1a5a93dfc] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:26.389190 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-179067cc-3767-46e7-988f-5692ffcd98f7 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:26.390438 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-179067cc-3767-46e7-988f-5692ffcd98f7 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:26.391682 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-179067cc-3767-46e7-988f-5692ffcd98f7 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:26.392447 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-179067cc-3767-46e7-988f-5692ffcd98f7 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:26.508700 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-a138a197-33a9-4bd1-8dd7-5081519edd18 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:26.510690 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-a138a197-33a9-4bd1-8dd7-5081519edd18 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 943a9a49-4fcd-46a5-b444-1a94f490ae2e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:26.518312 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-a138a197-33a9-4bd1-8dd7-5081519edd18 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:26.519038 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-a138a197-33a9-4bd1-8dd7-5081519edd18 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:26.520076 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-a138a197-33a9-4bd1-8dd7-5081519edd18 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:26.520738 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-a138a197-33a9-4bd1-8dd7-5081519edd18 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:26.633787 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-a138a197-33a9-4bd1-8dd7-5081519edd18 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:26.652724 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-a138a197-33a9-4bd1-8dd7-5081519edd18 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e" status: 200 len: 1303 microversion: 2.1 time: 0.148108 Jul 15 20:39:26.654307 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 202/396] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:26 2022] GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e => generated 1303 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:26.727284 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-179067cc-3767-46e7-988f-5692ffcd98f7 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145cee1016d349ceb93323a170bc957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f9e0f8edb42848965b3c6141e88d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:26.743197 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-179067cc-3767-46e7-988f-5692ffcd98f7 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] 10.222.0.66 "GET /compute/v2.1/servers/0d0462a7-7852-48bd-80ae-c0f1a5a93dfc" status: 200 len: 1514 microversion: 2.1 time: 0.376058 Jul 15 20:39:26.744230 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 195/397] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:26 2022] GET /compute/v2.1/servers/0d0462a7-7852-48bd-80ae-c0f1a5a93dfc => generated 1514 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:27.587268 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [req-74e11111-8206-49e4-ba43-3b1bd36084f8 req-1fc2b5ad-a321-4d44-9e6c-69f15e7abc04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d0462a7-7852-48bd-80ae-c0f1a5a93dfc", "name": "network-vif-deleted", "tag": "b9a5bff9-00b3-434f-b108-d1df2ac35acd"}]} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:39:27.613912 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-74e11111-8206-49e4-ba43-3b1bd36084f8 req-1fc2b5ad-a321-4d44-9e6c-69f15e7abc04 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:27.617681 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-74e11111-8206-49e4-ba43-3b1bd36084f8 req-1fc2b5ad-a321-4d44-9e6c-69f15e7abc04 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:27.631386 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.compute.server_external_events [req-74e11111-8206-49e4-ba43-3b1bd36084f8 req-1fc2b5ad-a321-4d44-9e6c-69f15e7abc04 service nova] Creating event network-vif-deleted:b9a5bff9-00b3-434f-b108-d1df2ac35acd for instance 0d0462a7-7852-48bd-80ae-c0f1a5a93dfc on hv-cinder-79987 Jul 15 20:39:27.648973 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [req-74e11111-8206-49e4-ba43-3b1bd36084f8 req-1fc2b5ad-a321-4d44-9e6c-69f15e7abc04 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068021 Jul 15 20:39:27.657906 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 203/398] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:39:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 20:39:27.673092 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-2570cfab-4155-490a-b48e-19910fa3c232 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:27.673919 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-2570cfab-4155-490a-b48e-19910fa3c232 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 943a9a49-4fcd-46a5-b444-1a94f490ae2e] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:27.681753 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2570cfab-4155-490a-b48e-19910fa3c232 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:27.683199 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2570cfab-4155-490a-b48e-19910fa3c232 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:27.684574 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2570cfab-4155-490a-b48e-19910fa3c232 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:27.685357 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2570cfab-4155-490a-b48e-19910fa3c232 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:27.762435 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-dbcdc02b-ea2a-4a22-9701-6998d1da2e5c tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:27.763483 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-dbcdc02b-ea2a-4a22-9701-6998d1da2e5c tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] [instance: 0d0462a7-7852-48bd-80ae-c0f1a5a93dfc] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:27.800240 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-dbcdc02b-ea2a-4a22-9701-6998d1da2e5c tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:27.804927 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-dbcdc02b-ea2a-4a22-9701-6998d1da2e5c tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:27.810229 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-dbcdc02b-ea2a-4a22-9701-6998d1da2e5c tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:27.813742 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-dbcdc02b-ea2a-4a22-9701-6998d1da2e5c tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:27.865640 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-dbcdc02b-ea2a-4a22-9701-6998d1da2e5c tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:27.866986 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-dbcdc02b-ea2a-4a22-9701-6998d1da2e5c tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:27.867804 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.objects.instance [None req-dbcdc02b-ea2a-4a22-9701-6998d1da2e5c tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lazy-loading 'fault' on Instance uuid 0d0462a7-7852-48bd-80ae-c0f1a5a93dfc {{(pid=124430) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 20:39:28.083209 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-dbcdc02b-ea2a-4a22-9701-6998d1da2e5c tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145cee1016d349ceb93323a170bc957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f9e0f8edb42848965b3c6141e88d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:28.094568 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-dbcdc02b-ea2a-4a22-9701-6998d1da2e5c tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] 10.222.0.66 "GET /compute/v2.1/servers/0d0462a7-7852-48bd-80ae-c0f1a5a93dfc" status: 200 len: 1308 microversion: 2.1 time: 0.336973 Jul 15 20:39:28.095327 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 204/399] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:27 2022] GET /compute/v2.1/servers/0d0462a7-7852-48bd-80ae-c0f1a5a93dfc => generated 1308 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:28.278465 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-2570cfab-4155-490a-b48e-19910fa3c232 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:28.288311 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-2570cfab-4155-490a-b48e-19910fa3c232 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e" status: 200 len: 1371 microversion: 2.1 time: 0.620732 Jul 15 20:39:28.289198 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 196/400] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:27 2022] GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e => generated 1371 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:29.113288 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-73bd4c1b-9bdd-46a0-a881-919b4ab879c2 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:29.114707 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-73bd4c1b-9bdd-46a0-a881-919b4ab879c2 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] [instance: 0d0462a7-7852-48bd-80ae-c0f1a5a93dfc] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:29.132500 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-73bd4c1b-9bdd-46a0-a881-919b4ab879c2 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:29.138348 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-73bd4c1b-9bdd-46a0-a881-919b4ab879c2 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:29.139873 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-73bd4c1b-9bdd-46a0-a881-919b4ab879c2 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:29.141824 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-73bd4c1b-9bdd-46a0-a881-919b4ab879c2 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:29.164448 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.wsgi [None req-73bd4c1b-9bdd-46a0-a881-919b4ab879c2 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] HTTP exception thrown: Instance 0d0462a7-7852-48bd-80ae-c0f1a5a93dfc could not be found. Jul 15 20:39:29.167997 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-73bd4c1b-9bdd-46a0-a881-919b4ab879c2 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Request method failure captured: Jul 15 20:39:29.167997 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: request: GET /compute/v2.1/servers/0d0462a7-7852-48bd-80ae-c0f1a5a93dfc HTTP/1.1 Jul 15 20:39:29.167997 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Accept: application/json Jul 15 20:39:29.167997 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Accept-Encoding: identity Jul 15 20:39:29.167997 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Connection: close Jul 15 20:39:29.167997 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Content-Length: 0 Jul 15 20:39:29.167997 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Content-Type: application/json Jul 15 20:39:29.167997 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Host: 10.222.0.66 Jul 15 20:39:29.167997 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Openstack-System-Scope: None Jul 15 20:39:29.167997 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: User-Agent: python-urllib3/1.26.9 Jul 15 20:39:29.167997 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Auth-Token: gAAAAABi0dA4I1xga-jLCh5y1GiPRuXSG3JiWJdIZfgo1h7g9LInspUzOmWBrdvntrPYBtfrnJYhXDL07Lg_A7VS9LCGIzglUrEhbBQE3wSEDKXlLHbeFj94wgMNHdarWF9bnKCw8D1TfsTbvn14lOwW00SBniyIr4umcFcfxCdoeBXC_VhWUU0 Jul 15 20:39:29.167997 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Domain-Id: None Jul 15 20:39:29.167997 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Domain-Name: None Jul 15 20:39:29.167997 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Identity-Status: Confirmed Jul 15 20:39:29.167997 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Is-Admin-Project: True Jul 15 20:39:29.167997 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Domain-Id: default Jul 15 20:39:29.167997 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Domain-Name: Default Jul 15 20:39:29.167997 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Id: 1e9f9e0f8edb42848965b3c6141e88d0 Jul 15 20:39:29.167997 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Name: tempest-VolumesSnapshotTestJSON-38155707 Jul 15 20:39:29.167997 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Role: member,reader Jul 15 20:39:29.167997 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Roles: member,reader Jul 15 20:39:29.169565 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1e9f9e0f8edb42848965b3c6141e88d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_1e9f9e0f8edb42848965b3c6141e88d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1e9f9e0f8edb42848965b3c6141e88d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/1e9f9e0f8edb42848965b3c6141e88d0"}]}] Jul 15 20:39:29.169565 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant: tempest-VolumesSnapshotTestJSON-38155707 Jul 15 20:39:29.169565 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant-Id: 1e9f9e0f8edb42848965b3c6141e88d0 Jul 15 20:39:29.169565 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-38155707 Jul 15 20:39:29.169565 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User: tempest-VolumesSnapshotTestJSON-38155707-project Jul 15 20:39:29.169565 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Domain-Id: default Jul 15 20:39:29.169565 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Domain-Name: Default Jul 15 20:39:29.169565 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Id: 145cee1016d349ceb93323a170bc957e Jul 15 20:39:29.169565 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Name: tempest-VolumesSnapshotTestJSON-38155707-project Jul 15 20:39:29.169565 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: method: > Jul 15 20:39:29.169565 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: exception: Instance 0d0462a7-7852-48bd-80ae-c0f1a5a93dfc could not be found. Jul 15 20:39:29.169565 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: action_args: {'id': '0d0462a7-7852-48bd-80ae-c0f1a5a93dfc'} Jul 15 20:39:29.170980 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 20:39:29.170980 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:39:29.170980 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 20:39:29.170980 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 20:39:29.170980 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 20:39:29.170980 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 20:39:29.170980 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 20:39:29.170980 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 20:39:29.170980 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 20:39:29.170980 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 20:39:29.170980 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d0462a7-7852-48bd-80ae-c0f1a5a93dfc could not be found. Jul 15 20:39:29.170980 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:39:29.170980 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:39:29.170980 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:39:29.170980 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:39:29.170980 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:39:29.170980 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:39:29.170980 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 20:39:29.170980 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 20:39:29.170980 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 20:39:29.173293 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 20:39:29.173293 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 20:39:29.173293 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 20:39:29.173293 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 20:39:29.173293 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 20:39:29.173293 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 20:39:29.173293 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 20:39:29.173293 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d0462a7-7852-48bd-80ae-c0f1a5a93dfc could not be found. Jul 15 20:39:29.173293 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:39:29.173293 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:39:29.173293 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:39:29.173293 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:39:29.173293 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:39:29.173293 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:39:29.173293 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 20:39:29.173293 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 20:39:29.173293 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d0462a7-7852-48bd-80ae-c0f1a5a93dfc could not be found. Jul 15 20:39:29.173293 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:39:29.176363 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-73bd4c1b-9bdd-46a0-a881-919b4ab879c2 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Returning 404 to user: Instance 0d0462a7-7852-48bd-80ae-c0f1a5a93dfc could not be found. {{(pid=124430) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 20:39:29.177820 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-73bd4c1b-9bdd-46a0-a881-919b4ab879c2 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] 10.222.0.66 "GET /compute/v2.1/servers/0d0462a7-7852-48bd-80ae-c0f1a5a93dfc" status: 404 len: 111 microversion: 2.1 time: 0.069786 Jul 15 20:39:29.182820 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 205/401] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:29 2022] GET /compute/v2.1/servers/0d0462a7-7852-48bd-80ae-c0f1a5a93dfc => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 20:39:29.311474 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-313d3f86-e25b-4023-8e6e-7b62704c3262 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:29.313009 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-313d3f86-e25b-4023-8e6e-7b62704c3262 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 943a9a49-4fcd-46a5-b444-1a94f490ae2e] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:29.321975 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-313d3f86-e25b-4023-8e6e-7b62704c3262 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:29.325843 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-313d3f86-e25b-4023-8e6e-7b62704c3262 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:29.330619 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-313d3f86-e25b-4023-8e6e-7b62704c3262 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:29.337737 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-313d3f86-e25b-4023-8e6e-7b62704c3262 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:29.654252 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-313d3f86-e25b-4023-8e6e-7b62704c3262 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:29.666933 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-313d3f86-e25b-4023-8e6e-7b62704c3262 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e" status: 200 len: 1371 microversion: 2.1 time: 0.363177 Jul 15 20:39:29.669987 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 197/402] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:29 2022] GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e => generated 1371 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:29.709908 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [req-770c4872-5b2e-437d-b170-6f33eecd8120 req-175c14b4-4eb7-40f4-bee7-9bbe28d5a4cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "943a9a49-4fcd-46a5-b444-1a94f490ae2e", "tag": "96d2f7c9-c3d8-4750-b9d0-3ab318ff06a1"}]} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:39:29.719859 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-770c4872-5b2e-437d-b170-6f33eecd8120 req-175c14b4-4eb7-40f4-bee7-9bbe28d5a4cc service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:29.720481 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-770c4872-5b2e-437d-b170-6f33eecd8120 req-175c14b4-4eb7-40f4-bee7-9bbe28d5a4cc service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:29.746510 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.compute.server_external_events [req-770c4872-5b2e-437d-b170-6f33eecd8120 req-175c14b4-4eb7-40f4-bee7-9bbe28d5a4cc service nova] Creating event network-changed:96d2f7c9-c3d8-4750-b9d0-3ab318ff06a1 for instance 943a9a49-4fcd-46a5-b444-1a94f490ae2e on hv-cinder-79987 Jul 15 20:39:29.753172 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [req-770c4872-5b2e-437d-b170-6f33eecd8120 req-175c14b4-4eb7-40f4-bee7-9bbe28d5a4cc service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046713 Jul 15 20:39:29.753776 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 206/403] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:39:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:39:30.687438 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-6018e761-fe86-4730-8046-f43d19aebc9a tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:30.688162 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-6018e761-fe86-4730-8046-f43d19aebc9a tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 943a9a49-4fcd-46a5-b444-1a94f490ae2e] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:30.694866 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6018e761-fe86-4730-8046-f43d19aebc9a tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:30.695581 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6018e761-fe86-4730-8046-f43d19aebc9a tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:30.696707 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6018e761-fe86-4730-8046-f43d19aebc9a tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:30.697376 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6018e761-fe86-4730-8046-f43d19aebc9a tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:30.855704 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-6018e761-fe86-4730-8046-f43d19aebc9a tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:30.863863 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-6018e761-fe86-4730-8046-f43d19aebc9a tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e" status: 200 len: 1371 microversion: 2.1 time: 0.180799 Jul 15 20:39:30.864627 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 198/404] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:30 2022] GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e => generated 1371 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:31.881198 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-a88c49fe-fc61-4642-b120-84631ce95e57 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:31.882533 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-a88c49fe-fc61-4642-b120-84631ce95e57 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 943a9a49-4fcd-46a5-b444-1a94f490ae2e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:31.891296 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-a88c49fe-fc61-4642-b120-84631ce95e57 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:31.892026 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-a88c49fe-fc61-4642-b120-84631ce95e57 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:31.892864 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-a88c49fe-fc61-4642-b120-84631ce95e57 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:31.893300 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-a88c49fe-fc61-4642-b120-84631ce95e57 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:32.157398 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-a88c49fe-fc61-4642-b120-84631ce95e57 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:32.172173 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-a88c49fe-fc61-4642-b120-84631ce95e57 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e" status: 200 len: 1371 microversion: 2.1 time: 0.295031 Jul 15 20:39:32.173018 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 207/405] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:31 2022] GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e => generated 1371 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:33.211893 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-6e563d33-9225-4893-80d0-a503b70c0933 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:33.213270 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-6e563d33-9225-4893-80d0-a503b70c0933 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 943a9a49-4fcd-46a5-b444-1a94f490ae2e] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:33.219697 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell0:SELECT=2 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:33.221778 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell0:SELECT=6 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:33.227311 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:33.229318 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6e563d33-9225-4893-80d0-a503b70c0933 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:33.230016 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6e563d33-9225-4893-80d0-a503b70c0933 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:33.231227 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6e563d33-9225-4893-80d0-a503b70c0933 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:33.232161 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6e563d33-9225-4893-80d0-a503b70c0933 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:33.521692 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-6e563d33-9225-4893-80d0-a503b70c0933 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:33.532037 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-6e563d33-9225-4893-80d0-a503b70c0933 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e" status: 200 len: 1371 microversion: 2.1 time: 0.337261 Jul 15 20:39:33.532828 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 199/406] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:33 2022] GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e => generated 1371 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:34.549437 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-da319187-7398-401a-836a-0467d1de0b19 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:34.550648 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-da319187-7398-401a-836a-0467d1de0b19 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 943a9a49-4fcd-46a5-b444-1a94f490ae2e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:34.556419 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_cell0:SELECT=6 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:34.558903 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-da319187-7398-401a-836a-0467d1de0b19 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:34.560101 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-da319187-7398-401a-836a-0467d1de0b19 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:34.561888 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-da319187-7398-401a-836a-0467d1de0b19 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:34.562584 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-da319187-7398-401a-836a-0467d1de0b19 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:34.731985 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-da319187-7398-401a-836a-0467d1de0b19 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:34.741105 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-da319187-7398-401a-836a-0467d1de0b19 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e" status: 200 len: 1371 microversion: 2.1 time: 0.195439 Jul 15 20:39:34.743022 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 208/407] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:34 2022] GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e => generated 1371 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:35.759064 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-f8934513-c5c3-4e3c-adfb-bd20cbca80b8 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:35.759636 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-f8934513-c5c3-4e3c-adfb-bd20cbca80b8 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 943a9a49-4fcd-46a5-b444-1a94f490ae2e] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:35.767457 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f8934513-c5c3-4e3c-adfb-bd20cbca80b8 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:35.767911 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f8934513-c5c3-4e3c-adfb-bd20cbca80b8 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:35.769340 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f8934513-c5c3-4e3c-adfb-bd20cbca80b8 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:35.769780 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f8934513-c5c3-4e3c-adfb-bd20cbca80b8 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:35.958277 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-f8934513-c5c3-4e3c-adfb-bd20cbca80b8 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:35.966248 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-f8934513-c5c3-4e3c-adfb-bd20cbca80b8 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e" status: 200 len: 1371 microversion: 2.1 time: 0.210938 Jul 15 20:39:35.966979 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 200/408] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:35 2022] GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e => generated 1371 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:36.983950 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-ed6a7693-0d88-4cf0-b83c-3a5d441d39a8 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:36.985551 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-ed6a7693-0d88-4cf0-b83c-3a5d441d39a8 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 943a9a49-4fcd-46a5-b444-1a94f490ae2e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:36.992048 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-ed6a7693-0d88-4cf0-b83c-3a5d441d39a8 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:36.992532 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-ed6a7693-0d88-4cf0-b83c-3a5d441d39a8 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:36.993297 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-ed6a7693-0d88-4cf0-b83c-3a5d441d39a8 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:36.993727 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-ed6a7693-0d88-4cf0-b83c-3a5d441d39a8 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:37.132018 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-ed6a7693-0d88-4cf0-b83c-3a5d441d39a8 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:37.142070 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-ed6a7693-0d88-4cf0-b83c-3a5d441d39a8 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e" status: 200 len: 1371 microversion: 2.1 time: 0.162814 Jul 15 20:39:37.148327 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 209/409] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:36 2022] GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:38.162666 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-e2fb2611-e292-440f-bd5e-6dc2266f281e tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:38.163917 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-e2fb2611-e292-440f-bd5e-6dc2266f281e tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 943a9a49-4fcd-46a5-b444-1a94f490ae2e] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:38.171756 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e2fb2611-e292-440f-bd5e-6dc2266f281e tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:38.172461 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e2fb2611-e292-440f-bd5e-6dc2266f281e tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:38.173360 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e2fb2611-e292-440f-bd5e-6dc2266f281e tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:38.173791 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e2fb2611-e292-440f-bd5e-6dc2266f281e tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:38.372052 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-e2fb2611-e292-440f-bd5e-6dc2266f281e tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:38.385512 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-e2fb2611-e292-440f-bd5e-6dc2266f281e tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e" status: 200 len: 1371 microversion: 2.1 time: 0.230491 Jul 15 20:39:38.386725 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 201/410] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:38 2022] GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e => generated 1371 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:39.403202 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-09ee185e-1ca4-4cff-9282-af63d5a41ce9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:39.404491 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-09ee185e-1ca4-4cff-9282-af63d5a41ce9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 943a9a49-4fcd-46a5-b444-1a94f490ae2e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:39.419067 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-09ee185e-1ca4-4cff-9282-af63d5a41ce9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:39.419809 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-09ee185e-1ca4-4cff-9282-af63d5a41ce9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:39.420622 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-09ee185e-1ca4-4cff-9282-af63d5a41ce9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:39.421901 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-09ee185e-1ca4-4cff-9282-af63d5a41ce9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:39.622750 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-09ee185e-1ca4-4cff-9282-af63d5a41ce9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:39.633926 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-e655a2b4-c810-4b95-97cc-bfa071bd994c tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1459353254", "imageRef": "a759604a-67e3-4c79-b848-5d03d936d7a0", "flavorRef": "452", "networks": [{"uuid": "1d4f92ae-9a3b-4eab-9e7b-eb670ca1dcff"}]}} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:39:39.640706 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-09ee185e-1ca4-4cff-9282-af63d5a41ce9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e" status: 200 len: 1371 microversion: 2.1 time: 0.241293 Jul 15 20:39:39.644492 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 210/411] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:39 2022] GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e => generated 1371 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:39.736681 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.network.neutron [None req-e655a2b4-c810-4b95-97cc-bfa071bd994c tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] validate_networks() for [('1d4f92ae-9a3b-4eab-9e7b-eb670ca1dcff', None, None, None, None, None)] {{(pid=124432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 20:39:40.409168 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-e655a2b4-c810-4b95-97cc-bfa071bd994c tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Flavor limits 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 20:39:40.409808 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-e655a2b4-c810-4b95-97cc-bfa071bd994c tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Image limits 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 20:39:40.410454 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-e655a2b4-c810-4b95-97cc-bfa071bd994c tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Flavor pref 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 20:39:40.411089 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-e655a2b4-c810-4b95-97cc-bfa071bd994c tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Image pref 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 20:39:40.412067 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-e655a2b4-c810-4b95-97cc-bfa071bd994c tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 20:39:40.425770 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e655a2b4-c810-4b95-97cc-bfa071bd994c tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:40.426459 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e655a2b4-c810-4b95-97cc-bfa071bd994c tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:40.427436 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e655a2b4-c810-4b95-97cc-bfa071bd994c tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:40.428034 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e655a2b4-c810-4b95-97cc-bfa071bd994c tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:40.449903 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:40.493426 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-e655a2b4-c810-4b95-97cc-bfa071bd994c tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Getting quotas for project 1e9f9e0f8edb42848965b3c6141e88d0. Resources: {'instances', 'ram', 'cores'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 20:39:40.505966 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-e655a2b4-c810-4b95-97cc-bfa071bd994c tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Getting quotas for user 145cee1016d349ceb93323a170bc957e and project 1e9f9e0f8edb42848965b3c6141e88d0. Resources: {'instances', 'ram', 'cores'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 20:39:40.531976 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-e655a2b4-c810-4b95-97cc-bfa071bd994c tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Going to run 1 instances... {{(pid=124432) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 20:39:40.535953 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-e655a2b4-c810-4b95-97cc-bfa071bd994c tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] [instance: 96e9395e-e62c-4127-b56d-435ef3dcb839] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a759604a-67e3-4c79-b848-5d03d936d7a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 20:39:40.648547 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-e655a2b4-c810-4b95-97cc-bfa071bd994c tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.018646 Jul 15 20:39:40.657137 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 202/412] 10.222.0.66 () {60 vars in 1146 bytes} [Fri Jul 15 20:39:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1028 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 20:39:40.660872 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-f65075a0-ef8a-4e39-bbd7-f093e6181bd0 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:40.661572 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-f65075a0-ef8a-4e39-bbd7-f093e6181bd0 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] [instance: 96e9395e-e62c-4127-b56d-435ef3dcb839] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:40.667573 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-f3fbd90b-a955-4fd4-a7a5-a8d3fe50439c tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:40.669163 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-f3fbd90b-a955-4fd4-a7a5-a8d3fe50439c tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 943a9a49-4fcd-46a5-b444-1a94f490ae2e] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:40.678943 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f3fbd90b-a955-4fd4-a7a5-a8d3fe50439c tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:40.679767 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f3fbd90b-a955-4fd4-a7a5-a8d3fe50439c tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:40.682325 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f3fbd90b-a955-4fd4-a7a5-a8d3fe50439c tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:40.683416 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f3fbd90b-a955-4fd4-a7a5-a8d3fe50439c tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:40.848198 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-f65075a0-ef8a-4e39-bbd7-f093e6181bd0 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145cee1016d349ceb93323a170bc957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f9e0f8edb42848965b3c6141e88d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:40.862228 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-f65075a0-ef8a-4e39-bbd7-f093e6181bd0 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] 10.222.0.66 "GET /compute/v2.1/servers/96e9395e-e62c-4127-b56d-435ef3dcb839" status: 200 len: 1219 microversion: 2.1 time: 0.204314 Jul 15 20:39:40.873201 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 211/413] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:40 2022] GET /compute/v2.1/servers/96e9395e-e62c-4127-b56d-435ef3dcb839 => generated 1219 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:41.125186 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-f3fbd90b-a955-4fd4-a7a5-a8d3fe50439c tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:41.134464 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-f3fbd90b-a955-4fd4-a7a5-a8d3fe50439c tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e" status: 200 len: 1371 microversion: 2.1 time: 0.471938 Jul 15 20:39:41.147793 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 203/414] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:40 2022] GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e => generated 1371 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:41.178232 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [req-c105cbd0-ef35-48b3-bcbb-1511c296927b req-bcb2d009-9ea5-433e-b913-214a70dad4df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "943a9a49-4fcd-46a5-b444-1a94f490ae2e", "name": "network-vif-plugged", "status": "completed", "tag": "96d2f7c9-c3d8-4750-b9d0-3ab318ff06a1"}]} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:39:41.193404 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-c105cbd0-ef35-48b3-bcbb-1511c296927b req-bcb2d009-9ea5-433e-b913-214a70dad4df service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:41.194282 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-c105cbd0-ef35-48b3-bcbb-1511c296927b req-bcb2d009-9ea5-433e-b913-214a70dad4df service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:41.211888 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.compute.server_external_events [req-c105cbd0-ef35-48b3-bcbb-1511c296927b req-bcb2d009-9ea5-433e-b913-214a70dad4df service nova] Creating event network-vif-plugged:96d2f7c9-c3d8-4750-b9d0-3ab318ff06a1 for instance 943a9a49-4fcd-46a5-b444-1a94f490ae2e on hv-cinder-79987 Jul 15 20:39:41.219350 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [req-c105cbd0-ef35-48b3-bcbb-1511c296927b req-bcb2d009-9ea5-433e-b913-214a70dad4df service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043622 Jul 15 20:39:41.220408 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 212/415] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:39:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 20:39:41.885037 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-5af834ff-5383-40f8-b879-61d948ccbeb8 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:41.886343 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-5af834ff-5383-40f8-b879-61d948ccbeb8 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] [instance: 96e9395e-e62c-4127-b56d-435ef3dcb839] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:41.895904 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5af834ff-5383-40f8-b879-61d948ccbeb8 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:41.896634 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5af834ff-5383-40f8-b879-61d948ccbeb8 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:41.897829 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5af834ff-5383-40f8-b879-61d948ccbeb8 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:41.898489 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5af834ff-5383-40f8-b879-61d948ccbeb8 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:42.002539 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-5af834ff-5383-40f8-b879-61d948ccbeb8 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145cee1016d349ceb93323a170bc957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f9e0f8edb42848965b3c6141e88d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:42.011071 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-5af834ff-5383-40f8-b879-61d948ccbeb8 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] 10.222.0.66 "GET /compute/v2.1/servers/96e9395e-e62c-4127-b56d-435ef3dcb839" status: 200 len: 1271 microversion: 2.1 time: 0.134114 Jul 15 20:39:42.012139 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 204/416] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:41 2022] GET /compute/v2.1/servers/96e9395e-e62c-4127-b56d-435ef3dcb839 => generated 1271 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:42.154446 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-42dcc21a-1597-4f45-8ff1-48d35f043a6d tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:42.156363 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-42dcc21a-1597-4f45-8ff1-48d35f043a6d tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 943a9a49-4fcd-46a5-b444-1a94f490ae2e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:42.158460 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=1 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:42.164970 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-42dcc21a-1597-4f45-8ff1-48d35f043a6d tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:42.164970 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-42dcc21a-1597-4f45-8ff1-48d35f043a6d tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:42.165687 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-42dcc21a-1597-4f45-8ff1-48d35f043a6d tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:42.166119 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-42dcc21a-1597-4f45-8ff1-48d35f043a6d tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:42.338667 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-42dcc21a-1597-4f45-8ff1-48d35f043a6d tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:42.346830 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-42dcc21a-1597-4f45-8ff1-48d35f043a6d tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e" status: 200 len: 1371 microversion: 2.1 time: 0.197274 Jul 15 20:39:42.347408 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 213/417] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:42 2022] GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e => generated 1371 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:43.030156 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-b5b18191-69ad-46ff-9847-0b2c20c9d6ec tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:43.030793 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-b5b18191-69ad-46ff-9847-0b2c20c9d6ec tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] [instance: 96e9395e-e62c-4127-b56d-435ef3dcb839] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:43.040191 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b5b18191-69ad-46ff-9847-0b2c20c9d6ec tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:43.040690 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b5b18191-69ad-46ff-9847-0b2c20c9d6ec tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:43.041706 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b5b18191-69ad-46ff-9847-0b2c20c9d6ec tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:43.042397 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b5b18191-69ad-46ff-9847-0b2c20c9d6ec tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:43.122943 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-b5b18191-69ad-46ff-9847-0b2c20c9d6ec tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145cee1016d349ceb93323a170bc957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f9e0f8edb42848965b3c6141e88d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:43.133604 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-b5b18191-69ad-46ff-9847-0b2c20c9d6ec tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] 10.222.0.66 "GET /compute/v2.1/servers/96e9395e-e62c-4127-b56d-435ef3dcb839" status: 200 len: 1271 microversion: 2.1 time: 0.108536 Jul 15 20:39:43.134497 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 205/418] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:43 2022] GET /compute/v2.1/servers/96e9395e-e62c-4127-b56d-435ef3dcb839 => generated 1271 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:43.366808 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-cdfa4b33-ef9f-40db-a1de-b4250c9f70ef tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:43.367342 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-cdfa4b33-ef9f-40db-a1de-b4250c9f70ef tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 943a9a49-4fcd-46a5-b444-1a94f490ae2e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:43.374749 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-cdfa4b33-ef9f-40db-a1de-b4250c9f70ef tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:43.376423 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-cdfa4b33-ef9f-40db-a1de-b4250c9f70ef tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:43.377470 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-cdfa4b33-ef9f-40db-a1de-b4250c9f70ef tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:43.378114 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-cdfa4b33-ef9f-40db-a1de-b4250c9f70ef tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:43.530846 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-cdfa4b33-ef9f-40db-a1de-b4250c9f70ef tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:43.543541 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-cdfa4b33-ef9f-40db-a1de-b4250c9f70ef tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e" status: 200 len: 1371 microversion: 2.1 time: 0.180784 Jul 15 20:39:43.544243 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 214/419] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:43 2022] GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e => generated 1371 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:44.153357 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-b52cb1df-5086-4446-b6e5-23ecd5fec452 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:44.154675 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-b52cb1df-5086-4446-b6e5-23ecd5fec452 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] [instance: 96e9395e-e62c-4127-b56d-435ef3dcb839] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:44.162716 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b52cb1df-5086-4446-b6e5-23ecd5fec452 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:44.163283 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b52cb1df-5086-4446-b6e5-23ecd5fec452 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:44.164291 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b52cb1df-5086-4446-b6e5-23ecd5fec452 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:44.164834 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b52cb1df-5086-4446-b6e5-23ecd5fec452 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:44.237268 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-b52cb1df-5086-4446-b6e5-23ecd5fec452 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145cee1016d349ceb93323a170bc957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f9e0f8edb42848965b3c6141e88d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:44.245625 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-b52cb1df-5086-4446-b6e5-23ecd5fec452 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] 10.222.0.66 "GET /compute/v2.1/servers/96e9395e-e62c-4127-b56d-435ef3dcb839" status: 200 len: 1271 microversion: 2.1 time: 0.098380 Jul 15 20:39:44.246188 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 206/420] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:44 2022] GET /compute/v2.1/servers/96e9395e-e62c-4127-b56d-435ef3dcb839 => generated 1271 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:44.561785 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-00af58a8-c478-4bce-9450-60fdf149ecd2 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:44.562541 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-00af58a8-c478-4bce-9450-60fdf149ecd2 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 943a9a49-4fcd-46a5-b444-1a94f490ae2e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:44.569193 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-00af58a8-c478-4bce-9450-60fdf149ecd2 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:44.569720 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-00af58a8-c478-4bce-9450-60fdf149ecd2 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:44.570510 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-00af58a8-c478-4bce-9450-60fdf149ecd2 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:44.570937 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-00af58a8-c478-4bce-9450-60fdf149ecd2 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:44.716228 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-00af58a8-c478-4bce-9450-60fdf149ecd2 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:44.725543 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-00af58a8-c478-4bce-9450-60fdf149ecd2 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e" status: 200 len: 1371 microversion: 2.1 time: 0.167773 Jul 15 20:39:44.726248 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 215/421] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:44 2022] GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e => generated 1371 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:45.263207 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-74d46d4f-73ab-4ade-a1d5-c79a0e7e3250 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:45.263798 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-74d46d4f-73ab-4ade-a1d5-c79a0e7e3250 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] [instance: 96e9395e-e62c-4127-b56d-435ef3dcb839] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:45.271509 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-74d46d4f-73ab-4ade-a1d5-c79a0e7e3250 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:45.271958 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-74d46d4f-73ab-4ade-a1d5-c79a0e7e3250 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:45.272767 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-74d46d4f-73ab-4ade-a1d5-c79a0e7e3250 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:45.273193 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-74d46d4f-73ab-4ade-a1d5-c79a0e7e3250 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:45.345409 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-74d46d4f-73ab-4ade-a1d5-c79a0e7e3250 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145cee1016d349ceb93323a170bc957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f9e0f8edb42848965b3c6141e88d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:45.353722 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-74d46d4f-73ab-4ade-a1d5-c79a0e7e3250 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] 10.222.0.66 "GET /compute/v2.1/servers/96e9395e-e62c-4127-b56d-435ef3dcb839" status: 200 len: 1271 microversion: 2.1 time: 0.094407 Jul 15 20:39:45.364037 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 207/422] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:45 2022] GET /compute/v2.1/servers/96e9395e-e62c-4127-b56d-435ef3dcb839 => generated 1271 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:45.743076 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-c6a9b484-be53-45ad-887a-7d69105eb677 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:45.744168 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-c6a9b484-be53-45ad-887a-7d69105eb677 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 943a9a49-4fcd-46a5-b444-1a94f490ae2e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:45.756070 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c6a9b484-be53-45ad-887a-7d69105eb677 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:45.758387 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c6a9b484-be53-45ad-887a-7d69105eb677 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:45.761219 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c6a9b484-be53-45ad-887a-7d69105eb677 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:45.765488 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c6a9b484-be53-45ad-887a-7d69105eb677 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:45.954741 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-c6a9b484-be53-45ad-887a-7d69105eb677 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:45.966393 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-c6a9b484-be53-45ad-887a-7d69105eb677 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e" status: 200 len: 1371 microversion: 2.1 time: 0.227066 Jul 15 20:39:45.978551 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 216/423] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:45 2022] GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e => generated 1371 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:46.372692 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-e74f6d65-194c-4d07-a192-c3c74103d388 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:46.373351 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-e74f6d65-194c-4d07-a192-c3c74103d388 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] [instance: 96e9395e-e62c-4127-b56d-435ef3dcb839] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:46.382480 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e74f6d65-194c-4d07-a192-c3c74103d388 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:46.383163 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e74f6d65-194c-4d07-a192-c3c74103d388 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:46.383932 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e74f6d65-194c-4d07-a192-c3c74103d388 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:46.384473 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e74f6d65-194c-4d07-a192-c3c74103d388 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:46.478429 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-e74f6d65-194c-4d07-a192-c3c74103d388 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145cee1016d349ceb93323a170bc957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f9e0f8edb42848965b3c6141e88d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:46.486866 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-e74f6d65-194c-4d07-a192-c3c74103d388 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] 10.222.0.66 "GET /compute/v2.1/servers/96e9395e-e62c-4127-b56d-435ef3dcb839" status: 200 len: 1277 microversion: 2.1 time: 0.119322 Jul 15 20:39:46.501793 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 208/424] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:46 2022] GET /compute/v2.1/servers/96e9395e-e62c-4127-b56d-435ef3dcb839 => generated 1277 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:46.995165 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-b9acc855-50cc-4ca0-af5d-cfd8c884339f tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:46.996820 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-b9acc855-50cc-4ca0-af5d-cfd8c884339f tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 943a9a49-4fcd-46a5-b444-1a94f490ae2e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:47.004418 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b9acc855-50cc-4ca0-af5d-cfd8c884339f tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:47.004888 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b9acc855-50cc-4ca0-af5d-cfd8c884339f tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:47.005723 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b9acc855-50cc-4ca0-af5d-cfd8c884339f tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:47.007057 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b9acc855-50cc-4ca0-af5d-cfd8c884339f tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:47.019341 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-4ed1bc3f-cce6-4f53-adf6-e0bb0e8ab276 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Action: 'create', calling method: .version_select at 0x7ff5183b7820>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1508719023", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM4ZDCs3uWzmCWPb3WT9B+V0ziketlVVZL7d78MNZnnDBorkWkJT1AjyysOvbh/UXBMXEsf+rTFcFuJUvemKzBQGtWy7ncJWK9w3E75kYE2rgLGKm2wWpQwJQuU/GbBvKw=="}} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:39:47.035886 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-4ed1bc3f-cce6-4f53-adf6-e0bb0e8ab276 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Getting quotas for project 37d62130d6f74b8e919e429cbb3afc55. Resources: {'key_pairs'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 20:39:47.042925 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-4ed1bc3f-cce6-4f53-adf6-e0bb0e8ab276 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Getting quotas for user 30a573525d244ab3ab69095db8871f20 and project 37d62130d6f74b8e919e429cbb3afc55. Resources: {'key_pairs'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 20:39:47.081531 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-4ed1bc3f-cce6-4f53-adf6-e0bb0e8ab276 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.065843 Jul 15 20:39:47.082326 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 209/425] 10.222.0.66 () {60 vars in 1158 bytes} [Fri Jul 15 20:39:47 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:39:47.139260 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-8da295c3-4aef-4f25-8e77-94c291541532 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-669024020", "imageRef": "6217cc29-6694-46df-b101-61378bc0751b", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1508719023", "networks": [{"uuid": "7db4e431-107b-47f9-a3f3-42ea5ecaee3e"}]}} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:39:47.187682 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-b9acc855-50cc-4ca0-af5d-cfd8c884339f tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:47.191928 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:47.199484 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-b9acc855-50cc-4ca0-af5d-cfd8c884339f tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e" status: 200 len: 1566 microversion: 2.1 time: 0.208181 Jul 15 20:39:47.200693 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 217/426] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:46 2022] GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e => generated 1566 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:47.211000 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.network.neutron [None req-8da295c3-4aef-4f25-8e77-94c291541532 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] validate_networks() for [('7db4e431-107b-47f9-a3f3-42ea5ecaee3e', None, None, None, None, None)] {{(pid=124432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 20:39:47.219403 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-4a95640d-e181-41ec-8142-c09ae187d9f2 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:47.220376 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-4a95640d-e181-41ec-8142-c09ae187d9f2 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 943a9a49-4fcd-46a5-b444-1a94f490ae2e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:47.230426 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-4a95640d-e181-41ec-8142-c09ae187d9f2 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:47.231093 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-4a95640d-e181-41ec-8142-c09ae187d9f2 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:47.232220 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-4a95640d-e181-41ec-8142-c09ae187d9f2 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:47.233845 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-4a95640d-e181-41ec-8142-c09ae187d9f2 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:47.356254 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-4a95640d-e181-41ec-8142-c09ae187d9f2 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.142969 Jul 15 20:39:47.356903 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 218/427] 10.222.0.66 () {58 vars in 1274 bytes} [Fri Jul 15 20:39:47 2022] GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e/os-interface => generated 285 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:39:47.503934 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-7ca5b6ff-457c-49f6-93a8-9faf42bdfc13 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:47.506864 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-7ca5b6ff-457c-49f6-93a8-9faf42bdfc13 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] [instance: 96e9395e-e62c-4127-b56d-435ef3dcb839] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:47.515198 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-7ca5b6ff-457c-49f6-93a8-9faf42bdfc13 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:47.515632 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-7ca5b6ff-457c-49f6-93a8-9faf42bdfc13 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:47.516416 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-7ca5b6ff-457c-49f6-93a8-9faf42bdfc13 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:47.517414 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-7ca5b6ff-457c-49f6-93a8-9faf42bdfc13 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:47.792518 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-8da295c3-4aef-4f25-8e77-94c291541532 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Flavor limits 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 20:39:47.792981 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-8da295c3-4aef-4f25-8e77-94c291541532 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Image limits 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 20:39:47.793398 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-8da295c3-4aef-4f25-8e77-94c291541532 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Flavor pref 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 20:39:47.794007 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-8da295c3-4aef-4f25-8e77-94c291541532 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Image pref 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 20:39:47.794632 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-8da295c3-4aef-4f25-8e77-94c291541532 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 20:39:47.807684 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-7ca5b6ff-457c-49f6-93a8-9faf42bdfc13 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145cee1016d349ceb93323a170bc957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f9e0f8edb42848965b3c6141e88d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:47.819463 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-7ca5b6ff-457c-49f6-93a8-9faf42bdfc13 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] 10.222.0.66 "GET /compute/v2.1/servers/96e9395e-e62c-4127-b56d-435ef3dcb839" status: 200 len: 1319 microversion: 2.1 time: 0.319268 Jul 15 20:39:47.826447 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 219/428] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:47 2022] GET /compute/v2.1/servers/96e9395e-e62c-4127-b56d-435ef3dcb839 => generated 1319 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:47.838577 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8da295c3-4aef-4f25-8e77-94c291541532 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:47.839233 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8da295c3-4aef-4f25-8e77-94c291541532 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:47.840232 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8da295c3-4aef-4f25-8e77-94c291541532 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:47.840890 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8da295c3-4aef-4f25-8e77-94c291541532 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:47.862550 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-8da295c3-4aef-4f25-8e77-94c291541532 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Getting quotas for project 37d62130d6f74b8e919e429cbb3afc55. Resources: {'instances', 'ram', 'cores'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 20:39:47.867548 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-8da295c3-4aef-4f25-8e77-94c291541532 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Getting quotas for user 30a573525d244ab3ab69095db8871f20 and project 37d62130d6f74b8e919e429cbb3afc55. Resources: {'instances', 'ram', 'cores'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 20:39:47.882146 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-8da295c3-4aef-4f25-8e77-94c291541532 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Going to run 1 instances... {{(pid=124432) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 20:39:47.884274 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-8da295c3-4aef-4f25-8e77-94c291541532 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] [instance: 67ed2b36-9422-4f98-8a39-83c214eadae9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6217cc29-6694-46df-b101-61378bc0751b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 20:39:47.938185 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-8da295c3-4aef-4f25-8e77-94c291541532 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.802792 Jul 15 20:39:47.939165 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 210/429] 10.222.0.66 () {60 vars in 1146 bytes} [Fri Jul 15 20:39:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 804 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 20:39:47.948917 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-ff58ad8c-33d2-48a9-8515-f5c2bd13e543 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:47.949676 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-ff58ad8c-33d2-48a9-8515-f5c2bd13e543 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] [instance: 67ed2b36-9422-4f98-8a39-83c214eadae9] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:48.014678 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-ff58ad8c-33d2-48a9-8515-f5c2bd13e543 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a573525d244ab3ab69095db8871f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d62130d6f74b8e919e429cbb3afc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:48.026345 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-ff58ad8c-33d2-48a9-8515-f5c2bd13e543 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] 10.222.0.66 "GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9" status: 200 len: 1258 microversion: 2.1 time: 0.080503 Jul 15 20:39:48.028077 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 220/430] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:47 2022] GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9 => generated 1258 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:48.847162 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-28d46869-a514-4dbf-bf3d-b07a6455e2c1 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:48.847756 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-28d46869-a514-4dbf-bf3d-b07a6455e2c1 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] [instance: 96e9395e-e62c-4127-b56d-435ef3dcb839] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:48.854705 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-28d46869-a514-4dbf-bf3d-b07a6455e2c1 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:48.855156 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-28d46869-a514-4dbf-bf3d-b07a6455e2c1 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:48.855927 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-28d46869-a514-4dbf-bf3d-b07a6455e2c1 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:48.856361 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-28d46869-a514-4dbf-bf3d-b07a6455e2c1 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:48.987218 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-28d46869-a514-4dbf-bf3d-b07a6455e2c1 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145cee1016d349ceb93323a170bc957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f9e0f8edb42848965b3c6141e88d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:48.995299 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-28d46869-a514-4dbf-bf3d-b07a6455e2c1 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] 10.222.0.66 "GET /compute/v2.1/servers/96e9395e-e62c-4127-b56d-435ef3dcb839" status: 200 len: 1319 microversion: 2.1 time: 0.153589 Jul 15 20:39:48.995853 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 211/431] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:48 2022] GET /compute/v2.1/servers/96e9395e-e62c-4127-b56d-435ef3dcb839 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:49.043375 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-d46777d5-2b46-4fa7-9706-b51c4ca3b316 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:49.044013 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-d46777d5-2b46-4fa7-9706-b51c4ca3b316 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] [instance: 67ed2b36-9422-4f98-8a39-83c214eadae9] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:49.052322 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-ec595653-d3dd-4bd9-8a86-8ecf7b5b6843 req-07ef368a-9874-4e90-ba7f-416601c5381e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96e9395e-e62c-4127-b56d-435ef3dcb839", "tag": "38f9e10c-b8ff-4602-a5f7-f0aa2f8e09be"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:39:49.060706 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d46777d5-2b46-4fa7-9706-b51c4ca3b316 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:49.061669 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d46777d5-2b46-4fa7-9706-b51c4ca3b316 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:49.062446 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d46777d5-2b46-4fa7-9706-b51c4ca3b316 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:49.063061 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d46777d5-2b46-4fa7-9706-b51c4ca3b316 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:49.063517 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-ec595653-d3dd-4bd9-8a86-8ecf7b5b6843 req-07ef368a-9874-4e90-ba7f-416601c5381e service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:49.063985 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-ec595653-d3dd-4bd9-8a86-8ecf7b5b6843 req-07ef368a-9874-4e90-ba7f-416601c5381e service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:49.074952 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-ec595653-d3dd-4bd9-8a86-8ecf7b5b6843 req-07ef368a-9874-4e90-ba7f-416601c5381e service nova] Creating event network-changed:38f9e10c-b8ff-4602-a5f7-f0aa2f8e09be for instance 96e9395e-e62c-4127-b56d-435ef3dcb839 on hv-cinder-79987 Jul 15 20:39:49.081920 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-ec595653-d3dd-4bd9-8a86-8ecf7b5b6843 req-07ef368a-9874-4e90-ba7f-416601c5381e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033116 Jul 15 20:39:49.082546 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 212/432] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:39:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:39:49.141853 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-d46777d5-2b46-4fa7-9706-b51c4ca3b316 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a573525d244ab3ab69095db8871f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d62130d6f74b8e919e429cbb3afc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:49.150102 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-d46777d5-2b46-4fa7-9706-b51c4ca3b316 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] 10.222.0.66 "GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9" status: 200 len: 1310 microversion: 2.1 time: 0.110830 Jul 15 20:39:49.151204 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 221/433] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:49 2022] GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9 => generated 1310 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:50.026144 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-a73a6f54-f37f-4e90-862e-cad7c57d9124 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:50.028953 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-a73a6f54-f37f-4e90-862e-cad7c57d9124 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] [instance: 96e9395e-e62c-4127-b56d-435ef3dcb839] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:50.054607 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a73a6f54-f37f-4e90-862e-cad7c57d9124 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:50.060616 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a73a6f54-f37f-4e90-862e-cad7c57d9124 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:50.063835 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a73a6f54-f37f-4e90-862e-cad7c57d9124 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:50.066547 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a73a6f54-f37f-4e90-862e-cad7c57d9124 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:50.173917 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-c2457a32-5ad3-43ca-871f-ff8664cebbb2 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:50.174612 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-c2457a32-5ad3-43ca-871f-ff8664cebbb2 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] [instance: 67ed2b36-9422-4f98-8a39-83c214eadae9] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:50.185630 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c2457a32-5ad3-43ca-871f-ff8664cebbb2 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:50.186676 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c2457a32-5ad3-43ca-871f-ff8664cebbb2 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:50.189755 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c2457a32-5ad3-43ca-871f-ff8664cebbb2 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:50.190304 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c2457a32-5ad3-43ca-871f-ff8664cebbb2 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:50.307916 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-c2457a32-5ad3-43ca-871f-ff8664cebbb2 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a573525d244ab3ab69095db8871f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d62130d6f74b8e919e429cbb3afc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:50.320772 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-c2457a32-5ad3-43ca-871f-ff8664cebbb2 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] 10.222.0.66 "GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9" status: 200 len: 1316 microversion: 2.1 time: 0.156534 Jul 15 20:39:50.323402 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 222/434] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:50 2022] GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9 => generated 1316 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:50.387683 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-a73a6f54-f37f-4e90-862e-cad7c57d9124 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145cee1016d349ceb93323a170bc957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f9e0f8edb42848965b3c6141e88d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:50.397635 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-a73a6f54-f37f-4e90-862e-cad7c57d9124 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] 10.222.0.66 "GET /compute/v2.1/servers/96e9395e-e62c-4127-b56d-435ef3dcb839" status: 200 len: 1319 microversion: 2.1 time: 0.386453 Jul 15 20:39:50.398845 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 213/435] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:50 2022] GET /compute/v2.1/servers/96e9395e-e62c-4127-b56d-435ef3dcb839 => generated 1319 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:51.103596 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [req-00329f66-2f79-419f-87d9-4c15fdb69bce req-b7470f50-00b5-457d-834e-e9bb65dc3ab6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "943a9a49-4fcd-46a5-b444-1a94f490ae2e", "tag": "96d2f7c9-c3d8-4750-b9d0-3ab318ff06a1"}]} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:39:51.116119 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-00329f66-2f79-419f-87d9-4c15fdb69bce req-b7470f50-00b5-457d-834e-e9bb65dc3ab6 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:51.116590 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-00329f66-2f79-419f-87d9-4c15fdb69bce req-b7470f50-00b5-457d-834e-e9bb65dc3ab6 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:51.131988 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.compute.server_external_events [req-00329f66-2f79-419f-87d9-4c15fdb69bce req-b7470f50-00b5-457d-834e-e9bb65dc3ab6 service nova] Creating event network-changed:96d2f7c9-c3d8-4750-b9d0-3ab318ff06a1 for instance 943a9a49-4fcd-46a5-b444-1a94f490ae2e on hv-cinder-79987 Jul 15 20:39:51.137501 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [req-00329f66-2f79-419f-87d9-4c15fdb69bce req-b7470f50-00b5-457d-834e-e9bb65dc3ab6 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037673 Jul 15 20:39:51.138803 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 223/436] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:39:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:39:51.339508 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-f7032e6e-165b-4d98-90a3-8c12d5b553c7 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:51.340111 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-f7032e6e-165b-4d98-90a3-8c12d5b553c7 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] [instance: 67ed2b36-9422-4f98-8a39-83c214eadae9] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:51.347247 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f7032e6e-165b-4d98-90a3-8c12d5b553c7 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:51.347651 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f7032e6e-165b-4d98-90a3-8c12d5b553c7 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:51.348676 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f7032e6e-165b-4d98-90a3-8c12d5b553c7 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:51.349234 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f7032e6e-165b-4d98-90a3-8c12d5b553c7 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:51.418197 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-a3283bbd-013e-4d7c-9575-3199c2ba692a tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:51.420343 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-a3283bbd-013e-4d7c-9575-3199c2ba692a tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] [instance: 96e9395e-e62c-4127-b56d-435ef3dcb839] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:51.427380 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-a3283bbd-013e-4d7c-9575-3199c2ba692a tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:51.427856 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-a3283bbd-013e-4d7c-9575-3199c2ba692a tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:51.428654 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-a3283bbd-013e-4d7c-9575-3199c2ba692a tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:51.429090 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-a3283bbd-013e-4d7c-9575-3199c2ba692a tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:51.519912 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-f7032e6e-165b-4d98-90a3-8c12d5b553c7 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a573525d244ab3ab69095db8871f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d62130d6f74b8e919e429cbb3afc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:51.529432 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-f7032e6e-165b-4d98-90a3-8c12d5b553c7 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] 10.222.0.66 "GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9" status: 200 len: 1358 microversion: 2.1 time: 0.193300 Jul 15 20:39:51.530821 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 214/437] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:51 2022] GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9 => generated 1358 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:51.586066 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-a3283bbd-013e-4d7c-9575-3199c2ba692a tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145cee1016d349ceb93323a170bc957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f9e0f8edb42848965b3c6141e88d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:51.593413 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-a3283bbd-013e-4d7c-9575-3199c2ba692a tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] 10.222.0.66 "GET /compute/v2.1/servers/96e9395e-e62c-4127-b56d-435ef3dcb839" status: 200 len: 1319 microversion: 2.1 time: 0.181832 Jul 15 20:39:51.593971 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 224/438] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:51 2022] GET /compute/v2.1/servers/96e9395e-e62c-4127-b56d-435ef3dcb839 => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:39:52.548041 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-5d5ff8fa-d603-4d6c-9a93-42dbdf50b321 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:52.548647 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-5d5ff8fa-d603-4d6c-9a93-42dbdf50b321 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] [instance: 67ed2b36-9422-4f98-8a39-83c214eadae9] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:52.555159 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5d5ff8fa-d603-4d6c-9a93-42dbdf50b321 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:52.555609 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5d5ff8fa-d603-4d6c-9a93-42dbdf50b321 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:52.556371 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5d5ff8fa-d603-4d6c-9a93-42dbdf50b321 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:52.556834 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5d5ff8fa-d603-4d6c-9a93-42dbdf50b321 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:52.611169 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-1dc6d51e-9c06-4b06-b39d-6f027337cd04 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:52.611965 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-1dc6d51e-9c06-4b06-b39d-6f027337cd04 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] [instance: 96e9395e-e62c-4127-b56d-435ef3dcb839] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:52.618709 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-1dc6d51e-9c06-4b06-b39d-6f027337cd04 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:52.619159 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-1dc6d51e-9c06-4b06-b39d-6f027337cd04 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:52.619963 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-1dc6d51e-9c06-4b06-b39d-6f027337cd04 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:52.620422 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-1dc6d51e-9c06-4b06-b39d-6f027337cd04 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:52.780726 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-5d5ff8fa-d603-4d6c-9a93-42dbdf50b321 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a573525d244ab3ab69095db8871f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d62130d6f74b8e919e429cbb3afc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:52.793184 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-5d5ff8fa-d603-4d6c-9a93-42dbdf50b321 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] 10.222.0.66 "GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9" status: 200 len: 1358 microversion: 2.1 time: 0.250038 Jul 15 20:39:52.794554 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 215/439] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:52 2022] GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9 => generated 1358 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:52.824970 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-1dc6d51e-9c06-4b06-b39d-6f027337cd04 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145cee1016d349ceb93323a170bc957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f9e0f8edb42848965b3c6141e88d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:52.832905 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-1dc6d51e-9c06-4b06-b39d-6f027337cd04 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] 10.222.0.66 "GET /compute/v2.1/servers/96e9395e-e62c-4127-b56d-435ef3dcb839" status: 200 len: 1319 microversion: 2.1 time: 0.226583 Jul 15 20:39:52.833476 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 225/440] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:52 2022] GET /compute/v2.1/servers/96e9395e-e62c-4127-b56d-435ef3dcb839 => generated 1319 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:39:53.810579 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-47258340-40db-48c9-9409-fadb8909e2de tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:53.811825 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-47258340-40db-48c9-9409-fadb8909e2de tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] [instance: 67ed2b36-9422-4f98-8a39-83c214eadae9] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:53.818389 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-47258340-40db-48c9-9409-fadb8909e2de tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:53.818831 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-47258340-40db-48c9-9409-fadb8909e2de tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:53.819606 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-47258340-40db-48c9-9409-fadb8909e2de tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:53.820032 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-47258340-40db-48c9-9409-fadb8909e2de tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:53.850024 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-b74da563-0196-412f-b396-ff3cf0be2d5f tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:53.850659 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-b74da563-0196-412f-b396-ff3cf0be2d5f tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] [instance: 96e9395e-e62c-4127-b56d-435ef3dcb839] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:53.857216 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b74da563-0196-412f-b396-ff3cf0be2d5f tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:53.858166 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b74da563-0196-412f-b396-ff3cf0be2d5f tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:53.859116 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b74da563-0196-412f-b396-ff3cf0be2d5f tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:53.859629 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b74da563-0196-412f-b396-ff3cf0be2d5f tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:54.004230 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-47258340-40db-48c9-9409-fadb8909e2de tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a573525d244ab3ab69095db8871f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d62130d6f74b8e919e429cbb3afc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:54.012156 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-47258340-40db-48c9-9409-fadb8909e2de tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] 10.222.0.66 "GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9" status: 200 len: 1358 microversion: 2.1 time: 0.205311 Jul 15 20:39:54.012763 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 216/441] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:53 2022] GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9 => generated 1358 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:54.033109 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-b74da563-0196-412f-b396-ff3cf0be2d5f tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145cee1016d349ceb93323a170bc957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f9e0f8edb42848965b3c6141e88d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:54.040405 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-b74da563-0196-412f-b396-ff3cf0be2d5f tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] 10.222.0.66 "GET /compute/v2.1/servers/96e9395e-e62c-4127-b56d-435ef3dcb839" status: 200 len: 1319 microversion: 2.1 time: 0.194100 Jul 15 20:39:54.040973 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 226/442] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:53 2022] GET /compute/v2.1/servers/96e9395e-e62c-4127-b56d-435ef3dcb839 => generated 1319 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:39:55.031846 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-9c13373d-caeb-4645-8e37-ac789f110203 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:55.032487 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-9c13373d-caeb-4645-8e37-ac789f110203 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] [instance: 67ed2b36-9422-4f98-8a39-83c214eadae9] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:55.040595 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9c13373d-caeb-4645-8e37-ac789f110203 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:55.041124 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9c13373d-caeb-4645-8e37-ac789f110203 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:55.042143 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9c13373d-caeb-4645-8e37-ac789f110203 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:55.042521 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9c13373d-caeb-4645-8e37-ac789f110203 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:55.057856 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-c147381e-1e50-4795-8f28-85b7d197900f tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:55.058605 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-c147381e-1e50-4795-8f28-85b7d197900f tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] [instance: 96e9395e-e62c-4127-b56d-435ef3dcb839] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:55.077285 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c147381e-1e50-4795-8f28-85b7d197900f tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:55.077762 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c147381e-1e50-4795-8f28-85b7d197900f tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:55.078895 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c147381e-1e50-4795-8f28-85b7d197900f tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:55.079418 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c147381e-1e50-4795-8f28-85b7d197900f tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:55.234130 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-9c13373d-caeb-4645-8e37-ac789f110203 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a573525d244ab3ab69095db8871f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d62130d6f74b8e919e429cbb3afc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:55.241862 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-9c13373d-caeb-4645-8e37-ac789f110203 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] 10.222.0.66 "GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9" status: 200 len: 1358 microversion: 2.1 time: 0.215514 Jul 15 20:39:55.242438 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 217/443] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:55 2022] GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9 => generated 1358 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:55.273938 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-c147381e-1e50-4795-8f28-85b7d197900f tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145cee1016d349ceb93323a170bc957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f9e0f8edb42848965b3c6141e88d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:55.281511 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-c147381e-1e50-4795-8f28-85b7d197900f tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] 10.222.0.66 "GET /compute/v2.1/servers/96e9395e-e62c-4127-b56d-435ef3dcb839" status: 200 len: 1319 microversion: 2.1 time: 0.228131 Jul 15 20:39:55.282138 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 227/444] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:55 2022] GET /compute/v2.1/servers/96e9395e-e62c-4127-b56d-435ef3dcb839 => generated 1319 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:39:56.259880 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-0afd89c8-5fd1-4d0c-aac5-47b7a735cbef tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:56.260604 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-0afd89c8-5fd1-4d0c-aac5-47b7a735cbef tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] [instance: 67ed2b36-9422-4f98-8a39-83c214eadae9] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:56.269445 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0afd89c8-5fd1-4d0c-aac5-47b7a735cbef tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:56.269992 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0afd89c8-5fd1-4d0c-aac5-47b7a735cbef tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:56.270863 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0afd89c8-5fd1-4d0c-aac5-47b7a735cbef tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:56.271372 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0afd89c8-5fd1-4d0c-aac5-47b7a735cbef tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:56.299152 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-398d46ea-2651-4309-aa2d-766075338aec tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:56.299747 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-398d46ea-2651-4309-aa2d-766075338aec tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] [instance: 96e9395e-e62c-4127-b56d-435ef3dcb839] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:56.308762 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-398d46ea-2651-4309-aa2d-766075338aec tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:56.309207 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-398d46ea-2651-4309-aa2d-766075338aec tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:56.309974 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-398d46ea-2651-4309-aa2d-766075338aec tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:56.310401 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-398d46ea-2651-4309-aa2d-766075338aec tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:56.465885 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-0afd89c8-5fd1-4d0c-aac5-47b7a735cbef tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a573525d244ab3ab69095db8871f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d62130d6f74b8e919e429cbb3afc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:56.474354 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-0afd89c8-5fd1-4d0c-aac5-47b7a735cbef tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] 10.222.0.66 "GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9" status: 200 len: 1358 microversion: 2.1 time: 0.218994 Jul 15 20:39:56.474917 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 218/445] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:56 2022] GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9 => generated 1358 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:56.495355 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-398d46ea-2651-4309-aa2d-766075338aec tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145cee1016d349ceb93323a170bc957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f9e0f8edb42848965b3c6141e88d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:56.503046 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-398d46ea-2651-4309-aa2d-766075338aec tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] 10.222.0.66 "GET /compute/v2.1/servers/96e9395e-e62c-4127-b56d-435ef3dcb839" status: 200 len: 1319 microversion: 2.1 time: 0.208580 Jul 15 20:39:56.503933 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 228/446] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:56 2022] GET /compute/v2.1/servers/96e9395e-e62c-4127-b56d-435ef3dcb839 => generated 1319 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:57.493740 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-d05603f6-98a5-4c8f-8e8b-200f19d7833b tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:57.494371 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-d05603f6-98a5-4c8f-8e8b-200f19d7833b tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] [instance: 67ed2b36-9422-4f98-8a39-83c214eadae9] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:57.501785 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d05603f6-98a5-4c8f-8e8b-200f19d7833b tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:57.502306 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d05603f6-98a5-4c8f-8e8b-200f19d7833b tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:57.503124 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d05603f6-98a5-4c8f-8e8b-200f19d7833b tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:57.503557 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d05603f6-98a5-4c8f-8e8b-200f19d7833b tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:57.523413 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-379f4e8f-14f6-4450-b6ed-202f87886e1b tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:57.524223 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-379f4e8f-14f6-4450-b6ed-202f87886e1b tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] [instance: 96e9395e-e62c-4127-b56d-435ef3dcb839] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:57.540141 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-379f4e8f-14f6-4450-b6ed-202f87886e1b tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:57.555596 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-379f4e8f-14f6-4450-b6ed-202f87886e1b tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:57.557049 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-379f4e8f-14f6-4450-b6ed-202f87886e1b tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:57.557513 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-379f4e8f-14f6-4450-b6ed-202f87886e1b tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:57.697579 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-d05603f6-98a5-4c8f-8e8b-200f19d7833b tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a573525d244ab3ab69095db8871f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d62130d6f74b8e919e429cbb3afc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:57.707815 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-d05603f6-98a5-4c8f-8e8b-200f19d7833b tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] 10.222.0.66 "GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9" status: 200 len: 1358 microversion: 2.1 time: 0.218855 Jul 15 20:39:57.709705 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 219/447] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:57 2022] GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9 => generated 1358 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:57.756453 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-379f4e8f-14f6-4450-b6ed-202f87886e1b tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145cee1016d349ceb93323a170bc957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f9e0f8edb42848965b3c6141e88d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:57.769394 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-379f4e8f-14f6-4450-b6ed-202f87886e1b tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] 10.222.0.66 "GET /compute/v2.1/servers/96e9395e-e62c-4127-b56d-435ef3dcb839" status: 200 len: 1319 microversion: 2.1 time: 0.251426 Jul 15 20:39:57.783786 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 229/448] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:57 2022] GET /compute/v2.1/servers/96e9395e-e62c-4127-b56d-435ef3dcb839 => generated 1319 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:58.730035 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-d4505e8d-8813-4906-8d1d-758973208830 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:58.730622 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-d4505e8d-8813-4906-8d1d-758973208830 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] [instance: 67ed2b36-9422-4f98-8a39-83c214eadae9] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:58.733230 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell0:SELECT=4 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:58.733906 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell0:SELECT=16 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:58.740808 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d4505e8d-8813-4906-8d1d-758973208830 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:58.741257 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d4505e8d-8813-4906-8d1d-758973208830 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:58.742030 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d4505e8d-8813-4906-8d1d-758973208830 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:58.742459 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d4505e8d-8813-4906-8d1d-758973208830 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:58.790113 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-02697ff4-1b4d-460c-878f-25d9b32ff8f9 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:39:58.790712 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-02697ff4-1b4d-460c-878f-25d9b32ff8f9 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] [instance: 96e9395e-e62c-4127-b56d-435ef3dcb839] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:39:58.797179 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_cell0:SELECT=4 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:39:58.799203 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-02697ff4-1b4d-460c-878f-25d9b32ff8f9 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:58.799862 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-02697ff4-1b4d-460c-878f-25d9b32ff8f9 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:58.800827 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-02697ff4-1b4d-460c-878f-25d9b32ff8f9 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:39:58.801444 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-02697ff4-1b4d-460c-878f-25d9b32ff8f9 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:39:58.975327 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-d4505e8d-8813-4906-8d1d-758973208830 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a573525d244ab3ab69095db8871f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d62130d6f74b8e919e429cbb3afc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:58.983774 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-d4505e8d-8813-4906-8d1d-758973208830 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] 10.222.0.66 "GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9" status: 200 len: 1358 microversion: 2.1 time: 0.257496 Jul 15 20:39:58.984344 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 220/449] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:58 2022] GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9 => generated 1358 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:39:59.020015 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-02697ff4-1b4d-460c-878f-25d9b32ff8f9 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145cee1016d349ceb93323a170bc957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f9e0f8edb42848965b3c6141e88d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:39:59.031571 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-02697ff4-1b4d-460c-878f-25d9b32ff8f9 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] 10.222.0.66 "GET /compute/v2.1/servers/96e9395e-e62c-4127-b56d-435ef3dcb839" status: 200 len: 1319 microversion: 2.1 time: 0.245133 Jul 15 20:39:59.043636 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 230/450] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:58 2022] GET /compute/v2.1/servers/96e9395e-e62c-4127-b56d-435ef3dcb839 => generated 1319 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:40:00.001760 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-698bfffc-20b2-4834-931f-81121f933413 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:00.002365 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-698bfffc-20b2-4834-931f-81121f933413 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] [instance: 67ed2b36-9422-4f98-8a39-83c214eadae9] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:00.008914 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-698bfffc-20b2-4834-931f-81121f933413 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:00.009363 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-698bfffc-20b2-4834-931f-81121f933413 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:00.010126 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-698bfffc-20b2-4834-931f-81121f933413 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:00.010565 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-698bfffc-20b2-4834-931f-81121f933413 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:00.053931 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-1f0b8a80-d394-4aac-a840-76e26a740ff5 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:00.054767 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-1f0b8a80-d394-4aac-a840-76e26a740ff5 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] [instance: 96e9395e-e62c-4127-b56d-435ef3dcb839] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:00.062715 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-1f0b8a80-d394-4aac-a840-76e26a740ff5 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:00.063508 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-1f0b8a80-d394-4aac-a840-76e26a740ff5 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:00.064523 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-1f0b8a80-d394-4aac-a840-76e26a740ff5 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:00.065317 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-1f0b8a80-d394-4aac-a840-76e26a740ff5 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:00.224787 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-698bfffc-20b2-4834-931f-81121f933413 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a573525d244ab3ab69095db8871f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d62130d6f74b8e919e429cbb3afc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:00.228240 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell1:SELECT=100 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:40:00.234302 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-698bfffc-20b2-4834-931f-81121f933413 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] 10.222.0.66 "GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9" status: 200 len: 1358 microversion: 2.1 time: 0.237546 Jul 15 20:40:00.234899 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 221/451] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:39:59 2022] GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9 => generated 1358 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:40:00.239960 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-1d2d5edc-12a1-4363-bfd1-b526ce4b98a6 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:00.240532 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-1d2d5edc-12a1-4363-bfd1-b526ce4b98a6 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:00.247229 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1d2d5edc-12a1-4363-bfd1-b526ce4b98a6 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:00.247677 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1d2d5edc-12a1-4363-bfd1-b526ce4b98a6 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:00.249131 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1d2d5edc-12a1-4363-bfd1-b526ce4b98a6 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:00.249723 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1d2d5edc-12a1-4363-bfd1-b526ce4b98a6 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:00.270607 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-1f0b8a80-d394-4aac-a840-76e26a740ff5 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145cee1016d349ceb93323a170bc957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f9e0f8edb42848965b3c6141e88d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:00.276298 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-1d2d5edc-12a1-4363-bfd1-b526ce4b98a6 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e/ips" status: 200 len: 145 microversion: 2.1 time: 0.040045 Jul 15 20:40:00.276898 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 222/452] 10.222.0.66 () {58 vars in 1247 bytes} [Fri Jul 15 20:40:00 2022] GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e/ips => generated 145 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:40:00.283177 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-1f0b8a80-d394-4aac-a840-76e26a740ff5 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] 10.222.0.66 "GET /compute/v2.1/servers/96e9395e-e62c-4127-b56d-435ef3dcb839" status: 200 len: 1319 microversion: 2.1 time: 0.234915 Jul 15 20:40:00.283751 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 231/453] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:00 2022] GET /compute/v2.1/servers/96e9395e-e62c-4127-b56d-435ef3dcb839 => generated 1319 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:40:01.252282 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-6360f3c0-72cd-40b4-a4ca-833ffd02a130 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:01.253164 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-6360f3c0-72cd-40b4-a4ca-833ffd02a130 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] [instance: 67ed2b36-9422-4f98-8a39-83c214eadae9] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:01.261698 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6360f3c0-72cd-40b4-a4ca-833ffd02a130 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:01.262177 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6360f3c0-72cd-40b4-a4ca-833ffd02a130 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:01.263108 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6360f3c0-72cd-40b4-a4ca-833ffd02a130 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:01.263782 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6360f3c0-72cd-40b4-a4ca-833ffd02a130 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:01.301459 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-2ffd5d5e-6a21-4eb5-a0b3-76c235254d28 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:01.302373 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-2ffd5d5e-6a21-4eb5-a0b3-76c235254d28 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] [instance: 96e9395e-e62c-4127-b56d-435ef3dcb839] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:01.312637 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-2ffd5d5e-6a21-4eb5-a0b3-76c235254d28 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:01.313405 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-2ffd5d5e-6a21-4eb5-a0b3-76c235254d28 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:01.314418 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-2ffd5d5e-6a21-4eb5-a0b3-76c235254d28 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:01.314852 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-2ffd5d5e-6a21-4eb5-a0b3-76c235254d28 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:01.451534 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-6360f3c0-72cd-40b4-a4ca-833ffd02a130 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a573525d244ab3ab69095db8871f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d62130d6f74b8e919e429cbb3afc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:01.465278 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-6360f3c0-72cd-40b4-a4ca-833ffd02a130 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] 10.222.0.66 "GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9" status: 200 len: 1358 microversion: 2.1 time: 0.218068 Jul 15 20:40:01.476458 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 223/454] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:01 2022] GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9 => generated 1358 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:40:01.514338 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-2ffd5d5e-6a21-4eb5-a0b3-76c235254d28 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145cee1016d349ceb93323a170bc957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f9e0f8edb42848965b3c6141e88d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:01.522973 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-2ffd5d5e-6a21-4eb5-a0b3-76c235254d28 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] 10.222.0.66 "GET /compute/v2.1/servers/96e9395e-e62c-4127-b56d-435ef3dcb839" status: 200 len: 1319 microversion: 2.1 time: 0.227663 Jul 15 20:40:01.523718 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 232/455] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:01 2022] GET /compute/v2.1/servers/96e9395e-e62c-4127-b56d-435ef3dcb839 => generated 1319 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:40:02.114303 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-71ce271a-c613-4afc-a6a8-54cb9ea20134 req-3788535c-5c2a-4175-93cd-b20dbb55efd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67ed2b36-9422-4f98-8a39-83c214eadae9", "tag": "138653ff-cbaa-43a2-9358-b327bc394857"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:40:02.122330 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-71ce271a-c613-4afc-a6a8-54cb9ea20134 req-3788535c-5c2a-4175-93cd-b20dbb55efd2 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:02.122994 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-71ce271a-c613-4afc-a6a8-54cb9ea20134 req-3788535c-5c2a-4175-93cd-b20dbb55efd2 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:02.136700 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-71ce271a-c613-4afc-a6a8-54cb9ea20134 req-3788535c-5c2a-4175-93cd-b20dbb55efd2 service nova] Creating event network-changed:138653ff-cbaa-43a2-9358-b327bc394857 for instance 67ed2b36-9422-4f98-8a39-83c214eadae9 on hv-cinder-79987 Jul 15 20:40:02.143203 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-71ce271a-c613-4afc-a6a8-54cb9ea20134 req-3788535c-5c2a-4175-93cd-b20dbb55efd2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032542 Jul 15 20:40:02.144097 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 224/456] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:40:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:40:02.483797 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-829fc329-5ad8-4b81-965f-6164dea7b495 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:02.484479 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-829fc329-5ad8-4b81-965f-6164dea7b495 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] [instance: 67ed2b36-9422-4f98-8a39-83c214eadae9] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:02.491460 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-829fc329-5ad8-4b81-965f-6164dea7b495 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:02.491991 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-829fc329-5ad8-4b81-965f-6164dea7b495 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:02.492950 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-829fc329-5ad8-4b81-965f-6164dea7b495 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:02.493473 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-829fc329-5ad8-4b81-965f-6164dea7b495 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:02.544182 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-cedd444d-5271-4ce7-b456-fe5c7cef0096 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:02.546372 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-cedd444d-5271-4ce7-b456-fe5c7cef0096 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] [instance: 96e9395e-e62c-4127-b56d-435ef3dcb839] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:02.553962 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-cedd444d-5271-4ce7-b456-fe5c7cef0096 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:02.554900 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-cedd444d-5271-4ce7-b456-fe5c7cef0096 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:02.556141 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-cedd444d-5271-4ce7-b456-fe5c7cef0096 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:02.556956 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-cedd444d-5271-4ce7-b456-fe5c7cef0096 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:02.805276 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-cedd444d-5271-4ce7-b456-fe5c7cef0096 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145cee1016d349ceb93323a170bc957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f9e0f8edb42848965b3c6141e88d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:02.812432 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-829fc329-5ad8-4b81-965f-6164dea7b495 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a573525d244ab3ab69095db8871f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d62130d6f74b8e919e429cbb3afc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:02.814950 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-cedd444d-5271-4ce7-b456-fe5c7cef0096 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] 10.222.0.66 "GET /compute/v2.1/servers/96e9395e-e62c-4127-b56d-435ef3dcb839" status: 200 len: 1319 microversion: 2.1 time: 0.276580 Jul 15 20:40:02.816376 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 225/457] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:02 2022] GET /compute/v2.1/servers/96e9395e-e62c-4127-b56d-435ef3dcb839 => generated 1319 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:40:02.829573 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-829fc329-5ad8-4b81-965f-6164dea7b495 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] 10.222.0.66 "GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9" status: 200 len: 1358 microversion: 2.1 time: 0.350513 Jul 15 20:40:02.840208 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 233/458] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:02 2022] GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9 => generated 1358 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:40:03.834291 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-53ca4256-5788-4387-96bc-27bfee15c8df tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:03.836206 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-53ca4256-5788-4387-96bc-27bfee15c8df tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] [instance: 96e9395e-e62c-4127-b56d-435ef3dcb839] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:03.839843 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=7 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:40:03.850347 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-7f7e6cb0-9b2b-4aca-8af3-72eb4fc3638d tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:03.851601 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-7f7e6cb0-9b2b-4aca-8af3-72eb4fc3638d tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] [instance: 67ed2b36-9422-4f98-8a39-83c214eadae9] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:03.859504 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-53ca4256-5788-4387-96bc-27bfee15c8df tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:03.860129 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-7f7e6cb0-9b2b-4aca-8af3-72eb4fc3638d tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:03.860791 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-7f7e6cb0-9b2b-4aca-8af3-72eb4fc3638d tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:03.860934 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-53ca4256-5788-4387-96bc-27bfee15c8df tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:03.861851 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-7f7e6cb0-9b2b-4aca-8af3-72eb4fc3638d tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:03.862443 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-7f7e6cb0-9b2b-4aca-8af3-72eb4fc3638d tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:03.867206 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-53ca4256-5788-4387-96bc-27bfee15c8df tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:03.867922 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-53ca4256-5788-4387-96bc-27bfee15c8df tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:04.329387 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-53ca4256-5788-4387-96bc-27bfee15c8df tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145cee1016d349ceb93323a170bc957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f9e0f8edb42848965b3c6141e88d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:04.339180 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-53ca4256-5788-4387-96bc-27bfee15c8df tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] 10.222.0.66 "GET /compute/v2.1/servers/96e9395e-e62c-4127-b56d-435ef3dcb839" status: 200 len: 1319 microversion: 2.1 time: 0.509419 Jul 15 20:40:04.348756 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-7f7e6cb0-9b2b-4aca-8af3-72eb4fc3638d tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a573525d244ab3ab69095db8871f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d62130d6f74b8e919e429cbb3afc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:04.349761 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 226/459] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:03 2022] GET /compute/v2.1/servers/96e9395e-e62c-4127-b56d-435ef3dcb839 => generated 1319 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:40:04.349888 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-7f7e6cb0-9b2b-4aca-8af3-72eb4fc3638d tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] 10.222.0.66 "GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9" status: 200 len: 1358 microversion: 2.1 time: 0.505901 Jul 15 20:40:04.350787 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 234/460] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:03 2022] GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9 => generated 1358 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:40:04.366076 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-f4a6f93c-a2f6-48da-bcdc-92fa3d1166fb tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ccd29187-ca61-4108-bb58-990735c5b3dd"}} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:40:04.368076 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-f4a6f93c-a2f6-48da-bcdc-92fa3d1166fb tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:04.376559 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f4a6f93c-a2f6-48da-bcdc-92fa3d1166fb tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:04.377391 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f4a6f93c-a2f6-48da-bcdc-92fa3d1166fb tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:04.378461 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f4a6f93c-a2f6-48da-bcdc-92fa3d1166fb tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:04.379271 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f4a6f93c-a2f6-48da-bcdc-92fa3d1166fb tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:05.071414 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [req-9462e935-0f6a-4c40-8a15-bab6a2858aee req-f962ca78-b829-4531-9af2-2899b75c8b7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96e9395e-e62c-4127-b56d-435ef3dcb839", "name": "network-vif-plugged", "status": "completed", "tag": "38f9e10c-b8ff-4602-a5f7-f0aa2f8e09be"}]} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:40:05.083201 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-9462e935-0f6a-4c40-8a15-bab6a2858aee req-f962ca78-b829-4531-9af2-2899b75c8b7b service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:05.084010 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-9462e935-0f6a-4c40-8a15-bab6a2858aee req-f962ca78-b829-4531-9af2-2899b75c8b7b service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:05.098710 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.compute.server_external_events [req-9462e935-0f6a-4c40-8a15-bab6a2858aee req-f962ca78-b829-4531-9af2-2899b75c8b7b service nova] Creating event network-vif-plugged:38f9e10c-b8ff-4602-a5f7-f0aa2f8e09be for instance 96e9395e-e62c-4127-b56d-435ef3dcb839 on hv-cinder-79987 Jul 15 20:40:05.104735 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [req-9462e935-0f6a-4c40-8a15-bab6a2858aee req-f962ca78-b829-4531-9af2-2899b75c8b7b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037110 Jul 15 20:40:05.105927 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 235/461] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:40:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:40:05.257376 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-f4a6f93c-a2f6-48da-bcdc-92fa3d1166fb tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "POST /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.895217 Jul 15 20:40:05.258079 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 227/462] 10.222.0.66 () {60 vars in 1322 bytes} [Fri Jul 15 20:40:04 2022] POST /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e/os-volume_attachments => generated 194 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:40:05.357861 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-1f6830c0-7796-4e25-80ad-16c2914b85c5 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:05.359222 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-1f6830c0-7796-4e25-80ad-16c2914b85c5 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] [instance: 96e9395e-e62c-4127-b56d-435ef3dcb839] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:05.368834 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-1f6830c0-7796-4e25-80ad-16c2914b85c5 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:05.369450 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-1f6830c0-7796-4e25-80ad-16c2914b85c5 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:05.369677 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-e1a08338-6437-4834-b0b6-e2be8ed2092e tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:05.370442 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-e1a08338-6437-4834-b0b6-e2be8ed2092e tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] [instance: 67ed2b36-9422-4f98-8a39-83c214eadae9] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:05.371026 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-1f6830c0-7796-4e25-80ad-16c2914b85c5 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:05.371814 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-1f6830c0-7796-4e25-80ad-16c2914b85c5 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:05.383057 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e1a08338-6437-4834-b0b6-e2be8ed2092e tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:05.383535 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e1a08338-6437-4834-b0b6-e2be8ed2092e tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:05.384330 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e1a08338-6437-4834-b0b6-e2be8ed2092e tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:05.385900 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e1a08338-6437-4834-b0b6-e2be8ed2092e tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:05.594804 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-e1a08338-6437-4834-b0b6-e2be8ed2092e tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a573525d244ab3ab69095db8871f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d62130d6f74b8e919e429cbb3afc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:05.604257 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-e1a08338-6437-4834-b0b6-e2be8ed2092e tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] 10.222.0.66 "GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9" status: 200 len: 1358 microversion: 2.1 time: 0.238955 Jul 15 20:40:05.614871 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 228/463] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:05 2022] GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9 => generated 1358 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:40:05.624056 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-1f6830c0-7796-4e25-80ad-16c2914b85c5 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145cee1016d349ceb93323a170bc957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f9e0f8edb42848965b3c6141e88d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:05.633570 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-1f6830c0-7796-4e25-80ad-16c2914b85c5 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] 10.222.0.66 "GET /compute/v2.1/servers/96e9395e-e62c-4127-b56d-435ef3dcb839" status: 200 len: 1319 microversion: 2.1 time: 0.280700 Jul 15 20:40:05.634387 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 236/464] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:05 2022] GET /compute/v2.1/servers/96e9395e-e62c-4127-b56d-435ef3dcb839 => generated 1319 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:40:06.630206 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-76d9a1d7-73d6-4d23-8f48-53bcbf32baa2 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:06.632214 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-76d9a1d7-73d6-4d23-8f48-53bcbf32baa2 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] [instance: 67ed2b36-9422-4f98-8a39-83c214eadae9] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:06.643814 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-76d9a1d7-73d6-4d23-8f48-53bcbf32baa2 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:06.645093 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-76d9a1d7-73d6-4d23-8f48-53bcbf32baa2 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:06.646925 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-76d9a1d7-73d6-4d23-8f48-53bcbf32baa2 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:06.647535 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-76d9a1d7-73d6-4d23-8f48-53bcbf32baa2 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:06.653192 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-34a924d3-bfab-4645-9965-450d5246a686 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:06.653723 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-34a924d3-bfab-4645-9965-450d5246a686 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] [instance: 96e9395e-e62c-4127-b56d-435ef3dcb839] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:06.664819 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-34a924d3-bfab-4645-9965-450d5246a686 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:06.665268 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-34a924d3-bfab-4645-9965-450d5246a686 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:06.666049 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-34a924d3-bfab-4645-9965-450d5246a686 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:06.666815 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-34a924d3-bfab-4645-9965-450d5246a686 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:06.701666 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_cell1:SELECT=100 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:40:06.940550 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-76d9a1d7-73d6-4d23-8f48-53bcbf32baa2 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a573525d244ab3ab69095db8871f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d62130d6f74b8e919e429cbb3afc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:06.950365 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-76d9a1d7-73d6-4d23-8f48-53bcbf32baa2 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] 10.222.0.66 "GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9" status: 200 len: 1358 microversion: 2.1 time: 0.331596 Jul 15 20:40:06.961408 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-34a924d3-bfab-4645-9965-450d5246a686 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145cee1016d349ceb93323a170bc957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f9e0f8edb42848965b3c6141e88d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:06.962568 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 229/465] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:06 2022] GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9 => generated 1358 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:40:06.985182 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-34a924d3-bfab-4645-9965-450d5246a686 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] 10.222.0.66 "GET /compute/v2.1/servers/96e9395e-e62c-4127-b56d-435ef3dcb839" status: 200 len: 1319 microversion: 2.1 time: 0.337850 Jul 15 20:40:06.986409 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 237/466] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:06 2022] GET /compute/v2.1/servers/96e9395e-e62c-4127-b56d-435ef3dcb839 => generated 1319 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:40:07.969450 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-0b44988d-e6fc-42ec-91bf-b910fec69c21 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:07.970131 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-0b44988d-e6fc-42ec-91bf-b910fec69c21 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] [instance: 67ed2b36-9422-4f98-8a39-83c214eadae9] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:07.978410 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0b44988d-e6fc-42ec-91bf-b910fec69c21 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:07.978863 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0b44988d-e6fc-42ec-91bf-b910fec69c21 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:07.979642 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0b44988d-e6fc-42ec-91bf-b910fec69c21 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:07.980250 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0b44988d-e6fc-42ec-91bf-b910fec69c21 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:08.002358 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-3bea55ac-c905-4c29-b2c6-d37caebb7721 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:08.002952 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-3bea55ac-c905-4c29-b2c6-d37caebb7721 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] [instance: 96e9395e-e62c-4127-b56d-435ef3dcb839] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:08.011743 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-3bea55ac-c905-4c29-b2c6-d37caebb7721 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:08.012502 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-3bea55ac-c905-4c29-b2c6-d37caebb7721 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:08.013006 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-3bea55ac-c905-4c29-b2c6-d37caebb7721 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:08.014692 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-3bea55ac-c905-4c29-b2c6-d37caebb7721 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:08.277433 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-0b44988d-e6fc-42ec-91bf-b910fec69c21 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a573525d244ab3ab69095db8871f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d62130d6f74b8e919e429cbb3afc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:08.288091 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-0b44988d-e6fc-42ec-91bf-b910fec69c21 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] 10.222.0.66 "GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9" status: 200 len: 1358 microversion: 2.1 time: 0.323245 Jul 15 20:40:08.299358 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 230/467] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:07 2022] GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9 => generated 1358 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:40:08.309852 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-3bea55ac-c905-4c29-b2c6-d37caebb7721 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145cee1016d349ceb93323a170bc957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f9e0f8edb42848965b3c6141e88d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:08.321760 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-3bea55ac-c905-4c29-b2c6-d37caebb7721 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] 10.222.0.66 "GET /compute/v2.1/servers/96e9395e-e62c-4127-b56d-435ef3dcb839" status: 200 len: 1508 microversion: 2.1 time: 0.323679 Jul 15 20:40:08.323497 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 238/468] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:07 2022] GET /compute/v2.1/servers/96e9395e-e62c-4127-b56d-435ef3dcb839 => generated 1508 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:40:08.340219 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-fa753fb8-1b40-4c80-82f2-df623d5a9e55 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc720eb3-785f-4287-8fb5-000acb46548a", "device": "/dev/sdb"}} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:40:08.341383 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-fa753fb8-1b40-4c80-82f2-df623d5a9e55 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] [instance: 96e9395e-e62c-4127-b56d-435ef3dcb839] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:08.348517 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fa753fb8-1b40-4c80-82f2-df623d5a9e55 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:08.349159 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fa753fb8-1b40-4c80-82f2-df623d5a9e55 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:08.350093 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fa753fb8-1b40-4c80-82f2-df623d5a9e55 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:08.350517 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fa753fb8-1b40-4c80-82f2-df623d5a9e55 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:08.678341 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-fa753fb8-1b40-4c80-82f2-df623d5a9e55 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] 10.222.0.66 "POST /compute/v2.1/servers/96e9395e-e62c-4127-b56d-435ef3dcb839/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.341676 Jul 15 20:40:08.684108 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 231/469] 10.222.0.66 () {60 vars in 1322 bytes} [Fri Jul 15 20:40:08 2022] POST /compute/v2.1/servers/96e9395e-e62c-4127-b56d-435ef3dcb839/os-volume_attachments => generated 194 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:40:09.106773 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [req-2f57d371-f0bd-4352-8706-0ab46658bbb9 req-5ca04628-925e-46b6-9dcd-f93375f3b730 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67ed2b36-9422-4f98-8a39-83c214eadae9", "name": "network-vif-plugged", "status": "completed", "tag": "138653ff-cbaa-43a2-9358-b327bc394857"}]} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:40:09.119697 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-2f57d371-f0bd-4352-8706-0ab46658bbb9 req-5ca04628-925e-46b6-9dcd-f93375f3b730 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:09.120488 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-2f57d371-f0bd-4352-8706-0ab46658bbb9 req-5ca04628-925e-46b6-9dcd-f93375f3b730 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:09.135481 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.compute.server_external_events [req-2f57d371-f0bd-4352-8706-0ab46658bbb9 req-5ca04628-925e-46b6-9dcd-f93375f3b730 service nova] Creating event network-vif-plugged:138653ff-cbaa-43a2-9358-b327bc394857 for instance 67ed2b36-9422-4f98-8a39-83c214eadae9 on hv-cinder-79987 Jul 15 20:40:09.141259 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [req-2f57d371-f0bd-4352-8706-0ab46658bbb9 req-5ca04628-925e-46b6-9dcd-f93375f3b730 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038893 Jul 15 20:40:09.142402 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 239/470] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:40:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:40:09.307016 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-fb1c3f69-784d-41a2-bfd8-1771c74de74e tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:09.307800 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-fb1c3f69-784d-41a2-bfd8-1771c74de74e tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] [instance: 67ed2b36-9422-4f98-8a39-83c214eadae9] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:09.332797 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fb1c3f69-784d-41a2-bfd8-1771c74de74e tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:09.334356 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fb1c3f69-784d-41a2-bfd8-1771c74de74e tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:09.335600 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fb1c3f69-784d-41a2-bfd8-1771c74de74e tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:09.336357 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fb1c3f69-784d-41a2-bfd8-1771c74de74e tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:09.765139 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-fb1c3f69-784d-41a2-bfd8-1771c74de74e tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a573525d244ab3ab69095db8871f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d62130d6f74b8e919e429cbb3afc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:09.776782 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-fb1c3f69-784d-41a2-bfd8-1771c74de74e tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] 10.222.0.66 "GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9" status: 200 len: 1358 microversion: 2.1 time: 0.475272 Jul 15 20:40:09.778554 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 232/471] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:09 2022] GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9 => generated 1358 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:40:10.799129 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-854b981d-4e75-4744-a2d8-f8f49e710fc3 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:10.799129 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-854b981d-4e75-4744-a2d8-f8f49e710fc3 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] [instance: 67ed2b36-9422-4f98-8a39-83c214eadae9] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:10.806952 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-854b981d-4e75-4744-a2d8-f8f49e710fc3 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:10.807660 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-854b981d-4e75-4744-a2d8-f8f49e710fc3 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:10.808684 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-854b981d-4e75-4744-a2d8-f8f49e710fc3 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:10.809286 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-854b981d-4e75-4744-a2d8-f8f49e710fc3 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:10.973526 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-854b981d-4e75-4744-a2d8-f8f49e710fc3 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a573525d244ab3ab69095db8871f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d62130d6f74b8e919e429cbb3afc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:10.987821 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-854b981d-4e75-4744-a2d8-f8f49e710fc3 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] 10.222.0.66 "GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9" status: 200 len: 1358 microversion: 2.1 time: 0.190965 Jul 15 20:40:10.990534 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 240/472] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:10 2022] GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9 => generated 1358 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:40:11.067707 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-a98ead84-3a75-4437-a44f-65a29fe942be tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:11.068302 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-a98ead84-3a75-4437-a44f-65a29fe942be tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 0f5cb5b0-4308-42bf-9145-9d88bd8af17c] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:11.075777 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a98ead84-3a75-4437-a44f-65a29fe942be tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:11.076890 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a98ead84-3a75-4437-a44f-65a29fe942be tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:11.077900 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a98ead84-3a75-4437-a44f-65a29fe942be tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:11.078953 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a98ead84-3a75-4437-a44f-65a29fe942be tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:11.106753 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-a98ead84-3a75-4437-a44f-65a29fe942be tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c/ips" status: 200 len: 150 microversion: 2.1 time: 0.042874 Jul 15 20:40:11.108808 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 233/473] 10.222.0.66 () {58 vars in 1247 bytes} [Fri Jul 15 20:40:11 2022] GET /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c/ips => generated 150 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:40:11.119699 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-2815ce11-43f0-4e84-8b93-8ed95887c016 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "954cc00f-a264-43df-93b2-ab7f5020d9fa"}} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:40:11.120665 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-2815ce11-43f0-4e84-8b93-8ed95887c016 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 0f5cb5b0-4308-42bf-9145-9d88bd8af17c] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:11.127758 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-2815ce11-43f0-4e84-8b93-8ed95887c016 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:11.128580 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-2815ce11-43f0-4e84-8b93-8ed95887c016 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:11.129575 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-2815ce11-43f0-4e84-8b93-8ed95887c016 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:11.130240 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-2815ce11-43f0-4e84-8b93-8ed95887c016 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:11.221102 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.wsgi [None req-2815ce11-43f0-4e84-8b93-8ed95887c016 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] HTTP exception thrown: Invalid volume: volume 954cc00f-a264-43df-93b2-ab7f5020d9fa is already attached to instances: f45998cc-d9ed-4dd5-acf0-caba5d56696d Jul 15 20:40:11.223464 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-2815ce11-43f0-4e84-8b93-8ed95887c016 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Request method failure captured: Jul 15 20:40:11.223464 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: request: POST /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c/os-volume_attachments HTTP/1.1 Jul 15 20:40:11.223464 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Accept: application/json Jul 15 20:40:11.223464 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Accept-Encoding: identity Jul 15 20:40:11.223464 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Connection: close Jul 15 20:40:11.223464 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Content-Length: 74 Jul 15 20:40:11.223464 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Content-Type: application/json Jul 15 20:40:11.223464 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Host: 10.222.0.66 Jul 15 20:40:11.223464 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Openstack-System-Scope: None Jul 15 20:40:11.223464 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: User-Agent: python-urllib3/1.26.9 Jul 15 20:40:11.223464 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Auth-Token: gAAAAABi0c_kH9ys3aP35h1LWWw3r1ieyA8CI0v0WIPPxjHmBB6aGubC4LmfLrm23mJ8HvmdkzR7wDAmSNK2w9OIr-gnn6Blv4WbaRzcu_QA8HGYGiqbz987b1vb5xUWoBYf2fTfD1m5oPgbP0g7S9YRfksUIFxkz4MW4lkoTMD9FFmUr-jPyfM Jul 15 20:40:11.223464 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Domain-Id: None Jul 15 20:40:11.223464 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Domain-Name: None Jul 15 20:40:11.223464 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Identity-Status: Confirmed Jul 15 20:40:11.223464 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Is-Admin-Project: True Jul 15 20:40:11.223464 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Domain-Id: default Jul 15 20:40:11.223464 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Domain-Name: Default Jul 15 20:40:11.223464 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Id: 78a593e163e74a7b9db61133e5c22035 Jul 15 20:40:11.223464 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Name: tempest-AttachVolumeNegativeTest-846080947 Jul 15 20:40:11.223464 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Role: member,reader Jul 15 20:40:11.223464 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Roles: member,reader Jul 15 20:40:11.224885 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/78a593e163e74a7b9db61133e5c22035"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_78a593e163e74a7b9db61133e5c22035"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/78a593e163e74a7b9db61133e5c22035"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/78a593e163e74a7b9db61133e5c22035"}]}] Jul 15 20:40:11.224885 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant: tempest-AttachVolumeNegativeTest-846080947 Jul 15 20:40:11.224885 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant-Id: 78a593e163e74a7b9db61133e5c22035 Jul 15 20:40:11.224885 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-846080947 Jul 15 20:40:11.224885 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User: tempest-AttachVolumeNegativeTest-846080947-project Jul 15 20:40:11.224885 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Domain-Id: default Jul 15 20:40:11.224885 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Domain-Name: Default Jul 15 20:40:11.224885 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Id: c0b5962b37b2470099436609425f7423 Jul 15 20:40:11.224885 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Name: tempest-AttachVolumeNegativeTest-846080947-project Jul 15 20:40:11.224885 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Jul 15 20:40:11.224885 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: {"volumeAttachment": {"volumeId": "954cc00f-a264-43df-93b2-ab7f5020d9fa"}} Jul 15 20:40:11.224885 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: method: > Jul 15 20:40:11.225610 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: exception: Invalid volume: volume 954cc00f-a264-43df-93b2-ab7f5020d9fa is already attached to instances: f45998cc-d9ed-4dd5-acf0-caba5d56696d Jul 15 20:40:11.225610 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: action_args: {'server_id': '0f5cb5b0-4308-42bf-9145-9d88bd8af17c', 'body': {'volumeAttachment': {'volumeId': '954cc00f-a264-43df-93b2-ab7f5020d9fa'}}} Jul 15 20:40:11.225610 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 20:40:11.225610 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:40:11.225610 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 15 20:40:11.225610 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 15 20:40:11.225610 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 15 20:40:11.225610 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 15 20:40:11.225610 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 15 20:40:11.225610 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 15 20:40:11.225610 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 15 20:40:11.225610 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 15 20:40:11.225610 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 15 20:40:11.225610 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 15 20:40:11.225610 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 954cc00f-a264-43df-93b2-ab7f5020d9fa is already attached to instances: f45998cc-d9ed-4dd5-acf0-caba5d56696d Jul 15 20:40:11.225610 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:40:11.225610 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:40:11.225610 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:40:11.225610 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:40:11.226726 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:40:11.226726 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:40:11.226726 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 20:40:11.226726 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 20:40:11.226726 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 20:40:11.226726 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 20:40:11.226726 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 15 20:40:11.226726 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 15 20:40:11.226726 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 15 20:40:11.226726 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 15 20:40:11.226726 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 15 20:40:11.226726 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 15 20:40:11.226726 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 15 20:40:11.226726 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 15 20:40:11.226726 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 954cc00f-a264-43df-93b2-ab7f5020d9fa is already attached to instances: f45998cc-d9ed-4dd5-acf0-caba5d56696d Jul 15 20:40:11.226726 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:40:11.226726 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:40:11.226726 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:40:11.226726 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:40:11.226726 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:40:11.227904 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:40:11.227904 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 20:40:11.227904 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 20:40:11.227904 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 954cc00f-a264-43df-93b2-ab7f5020d9fa is already attached to instances: f45998cc-d9ed-4dd5-acf0-caba5d56696d Jul 15 20:40:11.227904 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:40:11.230427 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-2815ce11-43f0-4e84-8b93-8ed95887c016 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Returning 400 to user: Invalid volume: volume 954cc00f-a264-43df-93b2-ab7f5020d9fa is already attached to instances: f45998cc-d9ed-4dd5-acf0-caba5d56696d {{(pid=124430) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 20:40:11.232625 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-2815ce11-43f0-4e84-8b93-8ed95887c016 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "POST /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.116754 Jul 15 20:40:11.237448 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 241/474] 10.222.0.66 () {60 vars in 1322 bytes} [Fri Jul 15 20:40:11 2022] POST /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c/os-volume_attachments => generated 174 bytes in 123 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 15 20:40:11.245764 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-0d570f57-8c29-4768-a206-ee8bf5841f08 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:11.246448 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-0d570f57-8c29-4768-a206-ee8bf5841f08 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 0f5cb5b0-4308-42bf-9145-9d88bd8af17c] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:11.287269 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0d570f57-8c29-4768-a206-ee8bf5841f08 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:11.287759 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0d570f57-8c29-4768-a206-ee8bf5841f08 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:11.289570 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0d570f57-8c29-4768-a206-ee8bf5841f08 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:11.290018 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0d570f57-8c29-4768-a206-ee8bf5841f08 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:11.337428 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-0d570f57-8c29-4768-a206-ee8bf5841f08 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 0f5cb5b0-4308-42bf-9145-9d88bd8af17c] Going to try to terminate instance {{(pid=124432) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 20:40:11.492956 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-0d570f57-8c29-4768-a206-ee8bf5841f08 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "DELETE /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c" status: 204 len: 0 microversion: 2.1 time: 0.253565 Jul 15 20:40:11.502540 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-0bbb9ed0-b857-4839-97ca-3a3e8c0efedf tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:11.502911 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 234/475] 10.222.0.66 () {58 vars in 1238 bytes} [Fri Jul 15 20:40:11 2022] DELETE /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 20:40:11.503765 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-0bbb9ed0-b857-4839-97ca-3a3e8c0efedf tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 0f5cb5b0-4308-42bf-9145-9d88bd8af17c] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:11.510877 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-0bbb9ed0-b857-4839-97ca-3a3e8c0efedf tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:11.511645 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-0bbb9ed0-b857-4839-97ca-3a3e8c0efedf tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:11.512576 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-0bbb9ed0-b857-4839-97ca-3a3e8c0efedf tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:11.513130 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-0bbb9ed0-b857-4839-97ca-3a3e8c0efedf tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:11.717487 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-0bbb9ed0-b857-4839-97ca-3a3e8c0efedf tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:11.729185 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-0bbb9ed0-b857-4839-97ca-3a3e8c0efedf tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c" status: 200 len: 1682 microversion: 2.1 time: 0.230490 Jul 15 20:40:11.737020 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 242/476] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:11 2022] GET /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c => generated 1682 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:40:12.009254 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-560cd19c-2e95-4d58-afc2-10b1d05ff636 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:12.010172 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-560cd19c-2e95-4d58-afc2-10b1d05ff636 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] [instance: 67ed2b36-9422-4f98-8a39-83c214eadae9] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:12.017568 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-560cd19c-2e95-4d58-afc2-10b1d05ff636 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:12.018260 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-560cd19c-2e95-4d58-afc2-10b1d05ff636 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:12.019203 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-560cd19c-2e95-4d58-afc2-10b1d05ff636 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:12.019792 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-560cd19c-2e95-4d58-afc2-10b1d05ff636 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:12.045122 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:40:12.235219 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-560cd19c-2e95-4d58-afc2-10b1d05ff636 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a573525d244ab3ab69095db8871f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d62130d6f74b8e919e429cbb3afc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:12.247182 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-560cd19c-2e95-4d58-afc2-10b1d05ff636 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] 10.222.0.66 "GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9" status: 200 len: 1548 microversion: 2.1 time: 0.242014 Jul 15 20:40:12.248914 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 235/477] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:12 2022] GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9 => generated 1548 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:40:12.268886 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-098c5f2e-0924-49e7-964a-ea2a23398030 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:12.270374 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-098c5f2e-0924-49e7-964a-ea2a23398030 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] [instance: 67ed2b36-9422-4f98-8a39-83c214eadae9] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:12.275659 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_api:SELECT=62 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:40:12.282473 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-098c5f2e-0924-49e7-964a-ea2a23398030 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:12.283075 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-098c5f2e-0924-49e7-964a-ea2a23398030 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:12.284404 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-098c5f2e-0924-49e7-964a-ea2a23398030 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:12.284969 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-098c5f2e-0924-49e7-964a-ea2a23398030 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:12.468440 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-098c5f2e-0924-49e7-964a-ea2a23398030 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a573525d244ab3ab69095db8871f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d62130d6f74b8e919e429cbb3afc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:12.476753 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-098c5f2e-0924-49e7-964a-ea2a23398030 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] 10.222.0.66 "GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9" status: 200 len: 1548 microversion: 2.1 time: 0.215064 Jul 15 20:40:12.477874 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 243/478] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:12 2022] GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9 => generated 1548 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:40:12.493609 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-08072819-9927-4eac-9ff0-81b2a9aa6161 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:12.498653 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-08072819-9927-4eac-9ff0-81b2a9aa6161 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '30a573525d244ab3ab69095db8871f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d62130d6f74b8e919e429cbb3afc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:12.499663 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-08072819-9927-4eac-9ff0-81b2a9aa6161 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Searching by: {'deleted': False, 'project_id': '37d62130d6f74b8e919e429cbb3afc55'} {{(pid=124432) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 15 20:40:12.507575 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-08072819-9927-4eac-9ff0-81b2a9aa6161 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:12.507997 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-08072819-9927-4eac-9ff0-81b2a9aa6161 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:12.509054 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-08072819-9927-4eac-9ff0-81b2a9aa6161 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:12.510064 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-08072819-9927-4eac-9ff0-81b2a9aa6161 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:12.632456 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.multi_cell_list [None req-08072819-9927-4eac-9ff0-81b2a9aa6161 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124432) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 15 20:40:12.746904 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-1952bd30-f9fb-45c9-a269-9e595e5e4107 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:12.748503 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-1952bd30-f9fb-45c9-a269-9e595e5e4107 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 0f5cb5b0-4308-42bf-9145-9d88bd8af17c] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:12.749168 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-08072819-9927-4eac-9ff0-81b2a9aa6161 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] 10.222.0.66 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.259525 Jul 15 20:40:12.754940 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 236/479] 10.222.0.66 () {58 vars in 1124 bytes} [Fri Jul 15 20:40:12 2022] GET /compute/v2.1/servers => generated 342 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:40:12.760527 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-1952bd30-f9fb-45c9-a269-9e595e5e4107 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:12.761175 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-1952bd30-f9fb-45c9-a269-9e595e5e4107 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:12.762107 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-1952bd30-f9fb-45c9-a269-9e595e5e4107 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:12.762688 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-1952bd30-f9fb-45c9-a269-9e595e5e4107 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:12.764741 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-2ae7809b-1dc2-414c-b16e-c22fa6bca025 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:12.765735 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-2ae7809b-1dc2-414c-b16e-c22fa6bca025 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] [instance: 67ed2b36-9422-4f98-8a39-83c214eadae9] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:12.778233 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2ae7809b-1dc2-414c-b16e-c22fa6bca025 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:12.778645 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2ae7809b-1dc2-414c-b16e-c22fa6bca025 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:12.779874 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2ae7809b-1dc2-414c-b16e-c22fa6bca025 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:12.780316 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2ae7809b-1dc2-414c-b16e-c22fa6bca025 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:13.005591 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-2ae7809b-1dc2-414c-b16e-c22fa6bca025 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a573525d244ab3ab69095db8871f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d62130d6f74b8e919e429cbb3afc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:13.016287 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-2ae7809b-1dc2-414c-b16e-c22fa6bca025 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] 10.222.0.66 "GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9" status: 200 len: 1548 microversion: 2.1 time: 0.260041 Jul 15 20:40:13.017065 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 237/480] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:12 2022] GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9 => generated 1548 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:40:13.038614 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-1952bd30-f9fb-45c9-a269-9e595e5e4107 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:13.053190 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-1952bd30-f9fb-45c9-a269-9e595e5e4107 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c" status: 200 len: 1682 microversion: 2.1 time: 0.309988 Jul 15 20:40:13.053775 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 244/481] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:12 2022] GET /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c => generated 1682 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:40:13.258858 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-4c3a425e-161e-4ea3-952e-8ac9f2bfcfba tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Action: 'create', calling method: .version_select at 0x7ff5183b7310>, body: {"keypair": {"name": "tempest-TestShelveInstance-203258470", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMC2W3yre42b5ZwSo7U5VQdn6jc4H80yXz/wX9j4uP0KyxsMORNtcgSjRMXD63dVcByMvxX7506lgRnCDWkrOLIjdButo3PCzfo4X0YOrB8j5kv+78bSGhHNwfjMfwf0yQ=="}} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:40:13.278709 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-4c3a425e-161e-4ea3-952e-8ac9f2bfcfba tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Getting quotas for project 13e1593c67704dbbafad13310ca35448. Resources: {'key_pairs'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 20:40:13.284111 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-4c3a425e-161e-4ea3-952e-8ac9f2bfcfba tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Getting quotas for user e2e27fccbf854a8b8c9d6d099893f783 and project 13e1593c67704dbbafad13310ca35448. Resources: {'key_pairs'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 20:40:13.324216 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-4c3a425e-161e-4ea3-952e-8ac9f2bfcfba tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.305889 Jul 15 20:40:13.324944 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 238/482] 10.222.0.66 () {60 vars in 1158 bytes} [Fri Jul 15 20:40:13 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:40:14.091905 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-a3e97045-0a44-479c-8d43-8fc7705956ac tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:40:14.094138 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-69b06918-7a13-486a-be13-623b5bc582f9 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:14.094754 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-69b06918-7a13-486a-be13-623b5bc582f9 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 0f5cb5b0-4308-42bf-9145-9d88bd8af17c] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:14.118782 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-69b06918-7a13-486a-be13-623b5bc582f9 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:14.120157 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a3e97045-0a44-479c-8d43-8fc7705956ac tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:14.120660 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a3e97045-0a44-479c-8d43-8fc7705956ac tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:14.121264 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-69b06918-7a13-486a-be13-623b5bc582f9 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:14.122090 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-69b06918-7a13-486a-be13-623b5bc582f9 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:14.126177 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-69b06918-7a13-486a-be13-623b5bc582f9 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:14.232962 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-a3e97045-0a44-479c-8d43-8fc7705956ac tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e] Going to try to stop instance {{(pid=124432) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 15 20:40:14.305298 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-a3e97045-0a44-479c-8d43-8fc7705956ac tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "POST /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e/action" status: 202 len: 0 microversion: 2.1 time: 0.220224 Jul 15 20:40:14.307237 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 239/483] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 15 20:40:14 2022] POST /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 15 20:40:14.331193 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-3b1bb951-5700-4085-949c-f6faf7b2d805 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:14.332117 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-3b1bb951-5700-4085-949c-f6faf7b2d805 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:14.346346 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3b1bb951-5700-4085-949c-f6faf7b2d805 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:14.352476 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3b1bb951-5700-4085-949c-f6faf7b2d805 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:14.352476 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3b1bb951-5700-4085-949c-f6faf7b2d805 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:14.352476 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3b1bb951-5700-4085-949c-f6faf7b2d805 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:14.839215 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-69b06918-7a13-486a-be13-623b5bc582f9 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:14.860690 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-3b1bb951-5700-4085-949c-f6faf7b2d805 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d12a685d9b419fa3606b5f4d1309fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af209f962144de4ae7e3575a3890096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:14.863464 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-69b06918-7a13-486a-be13-623b5bc582f9 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c" status: 200 len: 1682 microversion: 2.1 time: 0.794091 Jul 15 20:40:14.864277 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 245/484] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:14 2022] GET /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c => generated 1682 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:40:14.877865 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-03bae194-1688-44da-ae1e-45e62d56c615 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d53b1f18-ab46-491c-8e05-f492a7fdb298"}} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:40:14.878117 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-3b1bb951-5700-4085-949c-f6faf7b2d805 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e" status: 200 len: 1721 microversion: 2.1 time: 0.555518 Jul 15 20:40:14.878844 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 240/485] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:14 2022] GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e => generated 1721 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:40:14.881778 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-03bae194-1688-44da-ae1e-45e62d56c615 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] [instance: 67ed2b36-9422-4f98-8a39-83c214eadae9] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:14.902795 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-03bae194-1688-44da-ae1e-45e62d56c615 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:14.905153 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-03bae194-1688-44da-ae1e-45e62d56c615 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:14.907453 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-03bae194-1688-44da-ae1e-45e62d56c615 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:14.908593 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-03bae194-1688-44da-ae1e-45e62d56c615 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:15.213653 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-0956f9ff-7665-49aa-b092-a5fbd0ca9969 req-c5907cc2-ad16-4996-a17c-981b10e611ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f5cb5b0-4308-42bf-9145-9d88bd8af17c", "name": "network-vif-deleted", "tag": "1f2f6332-7e5b-4cf3-9154-434d47672d10"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:40:15.228636 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-0956f9ff-7665-49aa-b092-a5fbd0ca9969 req-c5907cc2-ad16-4996-a17c-981b10e611ef service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:15.229924 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-0956f9ff-7665-49aa-b092-a5fbd0ca9969 req-c5907cc2-ad16-4996-a17c-981b10e611ef service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:15.250015 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-0956f9ff-7665-49aa-b092-a5fbd0ca9969 req-c5907cc2-ad16-4996-a17c-981b10e611ef service nova] Creating event network-vif-deleted:1f2f6332-7e5b-4cf3-9154-434d47672d10 for instance 0f5cb5b0-4308-42bf-9145-9d88bd8af17c on hv-cinder-79987 Jul 15 20:40:15.256710 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-0956f9ff-7665-49aa-b092-a5fbd0ca9969 req-c5907cc2-ad16-4996-a17c-981b10e611ef service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048324 Jul 15 20:40:15.267867 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 241/486] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:40:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 20:40:15.372325 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-03bae194-1688-44da-ae1e-45e62d56c615 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] 10.222.0.66 "POST /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.505948 Jul 15 20:40:15.376729 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 246/487] 10.222.0.66 () {60 vars in 1322 bytes} [Fri Jul 15 20:40:14 2022] POST /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9/os-volume_attachments => generated 194 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:40:15.890035 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-7f54194b-0581-4706-9f93-8d57af834063 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:15.891634 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-7f54194b-0581-4706-9f93-8d57af834063 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 0f5cb5b0-4308-42bf-9145-9d88bd8af17c] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:15.898805 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-399a9d76-53fd-47e8-bf62-84b10f696a87 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:15.899727 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-399a9d76-53fd-47e8-bf62-84b10f696a87 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:15.905035 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7f54194b-0581-4706-9f93-8d57af834063 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:15.906347 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7f54194b-0581-4706-9f93-8d57af834063 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:15.908721 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7f54194b-0581-4706-9f93-8d57af834063 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:15.909588 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7f54194b-0581-4706-9f93-8d57af834063 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:15.914206 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-399a9d76-53fd-47e8-bf62-84b10f696a87 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:15.914663 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-399a9d76-53fd-47e8-bf62-84b10f696a87 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:15.922692 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-399a9d76-53fd-47e8-bf62-84b10f696a87 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:15.923178 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-399a9d76-53fd-47e8-bf62-84b10f696a87 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:16.001138 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7f54194b-0581-4706-9f93-8d57af834063 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:16.001868 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7f54194b-0581-4706-9f93-8d57af834063 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:16.002483 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.objects.instance [None req-7f54194b-0581-4706-9f93-8d57af834063 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lazy-loading 'fault' on Instance uuid 0f5cb5b0-4308-42bf-9145-9d88bd8af17c {{(pid=124432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 20:40:16.088979 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-7f54194b-0581-4706-9f93-8d57af834063 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:16.099104 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-7f54194b-0581-4706-9f93-8d57af834063 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c" status: 200 len: 1331 microversion: 2.1 time: 0.219629 Jul 15 20:40:16.100408 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 242/488] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:15 2022] GET /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c => generated 1331 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:40:16.137692 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-399a9d76-53fd-47e8-bf62-84b10f696a87 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d12a685d9b419fa3606b5f4d1309fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af209f962144de4ae7e3575a3890096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:16.146275 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-399a9d76-53fd-47e8-bf62-84b10f696a87 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e" status: 200 len: 1721 microversion: 2.1 time: 0.254153 Jul 15 20:40:16.147351 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 247/489] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:15 2022] GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e => generated 1721 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:40:17.117979 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-ba112bc3-51c6-4559-81ba-ece4a4c90163 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:17.118736 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-ba112bc3-51c6-4559-81ba-ece4a4c90163 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 0f5cb5b0-4308-42bf-9145-9d88bd8af17c] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:17.126576 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ba112bc3-51c6-4559-81ba-ece4a4c90163 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:17.127102 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ba112bc3-51c6-4559-81ba-ece4a4c90163 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:17.128095 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ba112bc3-51c6-4559-81ba-ece4a4c90163 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:17.128698 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ba112bc3-51c6-4559-81ba-ece4a4c90163 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:17.143762 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.wsgi [None req-ba112bc3-51c6-4559-81ba-ece4a4c90163 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] HTTP exception thrown: Instance 0f5cb5b0-4308-42bf-9145-9d88bd8af17c could not be found. Jul 15 20:40:17.145425 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-ba112bc3-51c6-4559-81ba-ece4a4c90163 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Request method failure captured: Jul 15 20:40:17.145425 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: request: GET /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c HTTP/1.1 Jul 15 20:40:17.145425 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Accept: application/json Jul 15 20:40:17.145425 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Accept-Encoding: identity Jul 15 20:40:17.145425 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Connection: close Jul 15 20:40:17.145425 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Content-Length: 0 Jul 15 20:40:17.145425 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Content-Type: application/json Jul 15 20:40:17.145425 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Host: 10.222.0.66 Jul 15 20:40:17.145425 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Openstack-System-Scope: None Jul 15 20:40:17.145425 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: User-Agent: python-urllib3/1.26.9 Jul 15 20:40:17.145425 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Auth-Token: gAAAAABi0c_kH9ys3aP35h1LWWw3r1ieyA8CI0v0WIPPxjHmBB6aGubC4LmfLrm23mJ8HvmdkzR7wDAmSNK2w9OIr-gnn6Blv4WbaRzcu_QA8HGYGiqbz987b1vb5xUWoBYf2fTfD1m5oPgbP0g7S9YRfksUIFxkz4MW4lkoTMD9FFmUr-jPyfM Jul 15 20:40:17.145425 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Domain-Id: None Jul 15 20:40:17.145425 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Domain-Name: None Jul 15 20:40:17.145425 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Identity-Status: Confirmed Jul 15 20:40:17.145425 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Is-Admin-Project: True Jul 15 20:40:17.145425 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Domain-Id: default Jul 15 20:40:17.145425 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Domain-Name: Default Jul 15 20:40:17.145425 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Id: 78a593e163e74a7b9db61133e5c22035 Jul 15 20:40:17.145425 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Name: tempest-AttachVolumeNegativeTest-846080947 Jul 15 20:40:17.145425 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Role: member,reader Jul 15 20:40:17.145425 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Roles: member,reader Jul 15 20:40:17.146910 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/78a593e163e74a7b9db61133e5c22035"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_78a593e163e74a7b9db61133e5c22035"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/78a593e163e74a7b9db61133e5c22035"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/78a593e163e74a7b9db61133e5c22035"}]}] Jul 15 20:40:17.146910 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Tenant: tempest-AttachVolumeNegativeTest-846080947 Jul 15 20:40:17.146910 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Tenant-Id: 78a593e163e74a7b9db61133e5c22035 Jul 15 20:40:17.146910 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-846080947 Jul 15 20:40:17.146910 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User: tempest-AttachVolumeNegativeTest-846080947-project Jul 15 20:40:17.146910 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Domain-Id: default Jul 15 20:40:17.146910 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Domain-Name: Default Jul 15 20:40:17.146910 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Id: c0b5962b37b2470099436609425f7423 Jul 15 20:40:17.146910 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Name: tempest-AttachVolumeNegativeTest-846080947-project Jul 15 20:40:17.146910 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: method: > Jul 15 20:40:17.146910 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: exception: Instance 0f5cb5b0-4308-42bf-9145-9d88bd8af17c could not be found. Jul 15 20:40:17.146910 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: action_args: {'id': '0f5cb5b0-4308-42bf-9145-9d88bd8af17c'} Jul 15 20:40:17.147740 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 20:40:17.147740 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:40:17.147740 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 20:40:17.147740 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 20:40:17.147740 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 20:40:17.147740 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 20:40:17.147740 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 20:40:17.147740 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 20:40:17.147740 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 20:40:17.147740 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 20:40:17.147740 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f5cb5b0-4308-42bf-9145-9d88bd8af17c could not be found. Jul 15 20:40:17.147740 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:40:17.147740 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:40:17.147740 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:40:17.147740 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:40:17.147740 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:40:17.147740 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:40:17.147740 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 20:40:17.147740 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 20:40:17.147740 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 20:40:17.149322 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 20:40:17.149322 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 20:40:17.149322 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 20:40:17.149322 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 20:40:17.149322 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 20:40:17.149322 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 20:40:17.149322 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 20:40:17.149322 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f5cb5b0-4308-42bf-9145-9d88bd8af17c could not be found. Jul 15 20:40:17.149322 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:40:17.149322 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:40:17.149322 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:40:17.149322 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:40:17.149322 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:40:17.149322 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:40:17.149322 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 20:40:17.149322 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 20:40:17.149322 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f5cb5b0-4308-42bf-9145-9d88bd8af17c could not be found. Jul 15 20:40:17.149322 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:40:17.150640 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-ba112bc3-51c6-4559-81ba-ece4a4c90163 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Returning 404 to user: Instance 0f5cb5b0-4308-42bf-9145-9d88bd8af17c could not be found. {{(pid=124432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 20:40:17.150640 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-ba112bc3-51c6-4559-81ba-ece4a4c90163 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c" status: 404 len: 111 microversion: 2.1 time: 0.033173 Jul 15 20:40:17.150640 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 243/490] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:17 2022] GET /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 20:40:17.155877 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-b7f220cd-c09c-4171-97b6-a879f9c476fc tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '.version_select at 0x7ff518397e50>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:17.164938 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-f275c22c-dd0b-4790-877b-69155a9908ce tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:17.165557 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-f275c22c-dd0b-4790-877b-69155a9908ce tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:17.172838 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f275c22c-dd0b-4790-877b-69155a9908ce tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:17.173407 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f275c22c-dd0b-4790-877b-69155a9908ce tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:17.180058 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-b7f220cd-c09c-4171-97b6-a879f9c476fc tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-138371225" status: 202 len: 0 microversion: 2.1 time: 0.025496 Jul 15 20:40:17.180058 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 248/491] 10.222.0.66 () {58 vars in 1217 bytes} [Fri Jul 15 20:40:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-138371225 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 20:40:17.181191 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f275c22c-dd0b-4790-877b-69155a9908ce tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:17.187250 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f275c22c-dd0b-4790-877b-69155a9908ce tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:17.337460 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-f275c22c-dd0b-4790-877b-69155a9908ce tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d12a685d9b419fa3606b5f4d1309fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af209f962144de4ae7e3575a3890096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:17.351549 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-f275c22c-dd0b-4790-877b-69155a9908ce tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e" status: 200 len: 1721 microversion: 2.1 time: 0.190449 Jul 15 20:40:17.353271 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 244/492] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:17 2022] GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e => generated 1721 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:40:18.024468 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-b77a5e00-d55a-4347-8003-4a80ffe9a75d tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:18.024916 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-b77a5e00-d55a-4347-8003-4a80ffe9a75d tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: f45998cc-d9ed-4dd5-acf0-caba5d56696d] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:18.034457 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b77a5e00-d55a-4347-8003-4a80ffe9a75d tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:18.035147 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b77a5e00-d55a-4347-8003-4a80ffe9a75d tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:18.036223 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b77a5e00-d55a-4347-8003-4a80ffe9a75d tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:18.036888 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b77a5e00-d55a-4347-8003-4a80ffe9a75d tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:18.142486 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.objects.instance [None req-b77a5e00-d55a-4347-8003-4a80ffe9a75d tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lazy-loading 'services' on Instance uuid f45998cc-d9ed-4dd5-acf0-caba5d56696d {{(pid=124430) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 20:40:18.237981 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-b77a5e00-d55a-4347-8003-4a80ffe9a75d tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "DELETE /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d/os-volume_attachments/954cc00f-a264-43df-93b2-ab7f5020d9fa" status: 202 len: 0 microversion: 2.1 time: 0.217582 Jul 15 20:40:18.238873 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 249/493] 10.222.0.66 () {58 vars in 1415 bytes} [Fri Jul 15 20:40:18 2022] DELETE /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d/os-volume_attachments/954cc00f-a264-43df-93b2-ab7f5020d9fa => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 20:40:18.248271 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-9366a48a-34be-4e0b-b587-06c4794a23a3 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:18.250692 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-9366a48a-34be-4e0b-b587-06c4794a23a3 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: f45998cc-d9ed-4dd5-acf0-caba5d56696d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:18.260199 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9366a48a-34be-4e0b-b587-06c4794a23a3 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:18.261480 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9366a48a-34be-4e0b-b587-06c4794a23a3 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:18.261906 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9366a48a-34be-4e0b-b587-06c4794a23a3 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:18.262497 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9366a48a-34be-4e0b-b587-06c4794a23a3 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:18.317044 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-9366a48a-34be-4e0b-b587-06c4794a23a3 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073523 Jul 15 20:40:18.317938 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 245/494] 10.222.0.66 () {58 vars in 1301 bytes} [Fri Jul 15 20:40:18 2022] GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:40:18.370865 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-2bc87af7-a9c4-44a9-8fdd-2379dd487194 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:18.371807 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-2bc87af7-a9c4-44a9-8fdd-2379dd487194 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:18.380087 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-2bc87af7-a9c4-44a9-8fdd-2379dd487194 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:18.380749 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-2bc87af7-a9c4-44a9-8fdd-2379dd487194 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:18.381579 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-2bc87af7-a9c4-44a9-8fdd-2379dd487194 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:18.381960 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-2bc87af7-a9c4-44a9-8fdd-2379dd487194 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:18.552069 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-2bc87af7-a9c4-44a9-8fdd-2379dd487194 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d12a685d9b419fa3606b5f4d1309fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af209f962144de4ae7e3575a3890096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:18.561166 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-2bc87af7-a9c4-44a9-8fdd-2379dd487194 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e" status: 200 len: 1721 microversion: 2.1 time: 0.194449 Jul 15 20:40:18.562201 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 250/495] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:18 2022] GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e => generated 1721 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:40:19.330086 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-abb33327-e2cb-45c4-9b72-bfc9116b22ea tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:19.331601 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-abb33327-e2cb-45c4-9b72-bfc9116b22ea tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: f45998cc-d9ed-4dd5-acf0-caba5d56696d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:19.340747 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-abb33327-e2cb-45c4-9b72-bfc9116b22ea tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:19.341248 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-abb33327-e2cb-45c4-9b72-bfc9116b22ea tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:19.343042 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-abb33327-e2cb-45c4-9b72-bfc9116b22ea tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:19.343487 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-abb33327-e2cb-45c4-9b72-bfc9116b22ea tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:19.376887 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-abb33327-e2cb-45c4-9b72-bfc9116b22ea tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051705 Jul 15 20:40:19.377468 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 246/496] 10.222.0.66 () {58 vars in 1301 bytes} [Fri Jul 15 20:40:19 2022] GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:40:19.579794 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-addd76cd-fde6-47af-a1c9-e5fca278558b tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:19.580414 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-addd76cd-fde6-47af-a1c9-e5fca278558b tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:19.586978 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-addd76cd-fde6-47af-a1c9-e5fca278558b tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:19.587424 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-addd76cd-fde6-47af-a1c9-e5fca278558b tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:19.588179 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-addd76cd-fde6-47af-a1c9-e5fca278558b tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:19.588634 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-addd76cd-fde6-47af-a1c9-e5fca278558b tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:19.723333 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-addd76cd-fde6-47af-a1c9-e5fca278558b tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d12a685d9b419fa3606b5f4d1309fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af209f962144de4ae7e3575a3890096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:19.731609 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-addd76cd-fde6-47af-a1c9-e5fca278558b tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e" status: 200 len: 1721 microversion: 2.1 time: 0.156075 Jul 15 20:40:19.732170 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 251/497] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:19 2022] GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:40:20.390329 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-aba45b20-951f-49c5-bccb-1af863752a54 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:20.391992 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-aba45b20-951f-49c5-bccb-1af863752a54 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: f45998cc-d9ed-4dd5-acf0-caba5d56696d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:20.398200 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-aba45b20-951f-49c5-bccb-1af863752a54 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:20.398652 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-aba45b20-951f-49c5-bccb-1af863752a54 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:20.399417 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-aba45b20-951f-49c5-bccb-1af863752a54 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:20.400045 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-aba45b20-951f-49c5-bccb-1af863752a54 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:20.435268 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-aba45b20-951f-49c5-bccb-1af863752a54 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051188 Jul 15 20:40:20.435982 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 247/498] 10.222.0.66 () {58 vars in 1301 bytes} [Fri Jul 15 20:40:20 2022] GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:40:20.749209 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-e9501c35-1e20-4708-bac0-d2b20bd4b7ca tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:20.750433 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-e9501c35-1e20-4708-bac0-d2b20bd4b7ca tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:20.758368 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e9501c35-1e20-4708-bac0-d2b20bd4b7ca tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:20.758814 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e9501c35-1e20-4708-bac0-d2b20bd4b7ca tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:20.759946 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e9501c35-1e20-4708-bac0-d2b20bd4b7ca tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:20.760352 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e9501c35-1e20-4708-bac0-d2b20bd4b7ca tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:20.912337 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-e9501c35-1e20-4708-bac0-d2b20bd4b7ca tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d12a685d9b419fa3606b5f4d1309fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af209f962144de4ae7e3575a3890096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:20.921322 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-e9501c35-1e20-4708-bac0-d2b20bd4b7ca tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e" status: 200 len: 1721 microversion: 2.1 time: 0.176436 Jul 15 20:40:20.921883 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 252/499] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:20 2022] GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:40:21.447772 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-977ae53f-f999-4a17-ba18-1651fc206ff9 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:21.448819 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-977ae53f-f999-4a17-ba18-1651fc206ff9 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: f45998cc-d9ed-4dd5-acf0-caba5d56696d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:21.456015 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-977ae53f-f999-4a17-ba18-1651fc206ff9 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:21.456522 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-977ae53f-f999-4a17-ba18-1651fc206ff9 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:21.457494 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-977ae53f-f999-4a17-ba18-1651fc206ff9 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:21.457927 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-977ae53f-f999-4a17-ba18-1651fc206ff9 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:21.488184 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-977ae53f-f999-4a17-ba18-1651fc206ff9 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044903 Jul 15 20:40:21.488837 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 248/500] 10.222.0.66 () {58 vars in 1301 bytes} [Fri Jul 15 20:40:21 2022] GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:40:21.939226 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-055974ec-4298-4797-ae4f-5fb705fa8991 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:21.939835 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-055974ec-4298-4797-ae4f-5fb705fa8991 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:21.949709 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-055974ec-4298-4797-ae4f-5fb705fa8991 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:21.949709 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-055974ec-4298-4797-ae4f-5fb705fa8991 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:21.949709 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-055974ec-4298-4797-ae4f-5fb705fa8991 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:21.949709 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-055974ec-4298-4797-ae4f-5fb705fa8991 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:21.969097 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:40:22.083004 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-055974ec-4298-4797-ae4f-5fb705fa8991 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d12a685d9b419fa3606b5f4d1309fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af209f962144de4ae7e3575a3890096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:22.090847 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-055974ec-4298-4797-ae4f-5fb705fa8991 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e" status: 200 len: 1721 microversion: 2.1 time: 0.156485 Jul 15 20:40:22.091972 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 253/501] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:21 2022] GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:40:22.500760 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-f35bdb13-62d0-4112-9531-b01aca9b1cb3 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:22.501667 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-f35bdb13-62d0-4112-9531-b01aca9b1cb3 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: f45998cc-d9ed-4dd5-acf0-caba5d56696d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:22.508324 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f35bdb13-62d0-4112-9531-b01aca9b1cb3 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:22.508797 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f35bdb13-62d0-4112-9531-b01aca9b1cb3 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:22.509542 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f35bdb13-62d0-4112-9531-b01aca9b1cb3 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:22.509966 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f35bdb13-62d0-4112-9531-b01aca9b1cb3 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:22.539088 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-f35bdb13-62d0-4112-9531-b01aca9b1cb3 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043143 Jul 15 20:40:22.539636 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 249/502] 10.222.0.66 () {58 vars in 1301 bytes} [Fri Jul 15 20:40:22 2022] GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:40:23.108815 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-f62b8739-e661-4488-90b3-08e0ca1a599f tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:23.109426 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-f62b8739-e661-4488-90b3-08e0ca1a599f tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:23.117010 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-f62b8739-e661-4488-90b3-08e0ca1a599f tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:23.117464 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-f62b8739-e661-4488-90b3-08e0ca1a599f tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:23.118246 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-f62b8739-e661-4488-90b3-08e0ca1a599f tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:23.118685 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-f62b8739-e661-4488-90b3-08e0ca1a599f tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:23.256057 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-f62b8739-e661-4488-90b3-08e0ca1a599f tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d12a685d9b419fa3606b5f4d1309fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af209f962144de4ae7e3575a3890096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:23.266908 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-f62b8739-e661-4488-90b3-08e0ca1a599f tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e" status: 200 len: 1721 microversion: 2.1 time: 0.161577 Jul 15 20:40:23.267484 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 254/503] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:23 2022] GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:40:23.551559 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-c6a5aeef-36c8-41dd-a1c7-c3af85ba45c5 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:23.552497 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-c6a5aeef-36c8-41dd-a1c7-c3af85ba45c5 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: f45998cc-d9ed-4dd5-acf0-caba5d56696d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:23.554495 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell0:SELECT=2 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:40:23.555190 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell0:SELECT=4 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:40:23.562792 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c6a5aeef-36c8-41dd-a1c7-c3af85ba45c5 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:23.563234 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c6a5aeef-36c8-41dd-a1c7-c3af85ba45c5 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:23.564004 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c6a5aeef-36c8-41dd-a1c7-c3af85ba45c5 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:23.564460 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c6a5aeef-36c8-41dd-a1c7-c3af85ba45c5 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:23.593505 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-c6a5aeef-36c8-41dd-a1c7-c3af85ba45c5 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045883 Jul 15 20:40:23.594265 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 250/504] 10.222.0.66 () {58 vars in 1301 bytes} [Fri Jul 15 20:40:23 2022] GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:40:24.285247 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-fef18f19-337a-494b-bbe9-5fd8ecc91b0f tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:24.285766 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-fef18f19-337a-494b-bbe9-5fd8ecc91b0f tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:24.292610 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-fef18f19-337a-494b-bbe9-5fd8ecc91b0f tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:24.293060 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-fef18f19-337a-494b-bbe9-5fd8ecc91b0f tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:24.293822 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-fef18f19-337a-494b-bbe9-5fd8ecc91b0f tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:24.294849 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-fef18f19-337a-494b-bbe9-5fd8ecc91b0f tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:24.433780 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-fef18f19-337a-494b-bbe9-5fd8ecc91b0f tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d12a685d9b419fa3606b5f4d1309fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af209f962144de4ae7e3575a3890096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:24.441861 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-fef18f19-337a-494b-bbe9-5fd8ecc91b0f tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e" status: 200 len: 1721 microversion: 2.1 time: 0.160880 Jul 15 20:40:24.442420 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 255/505] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:24 2022] GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:40:24.605414 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-9773e89c-0b52-439b-af64-c9088fd14197 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:24.606324 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-9773e89c-0b52-439b-af64-c9088fd14197 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: f45998cc-d9ed-4dd5-acf0-caba5d56696d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:24.613675 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9773e89c-0b52-439b-af64-c9088fd14197 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:24.614127 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9773e89c-0b52-439b-af64-c9088fd14197 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:24.614894 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9773e89c-0b52-439b-af64-c9088fd14197 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:24.615329 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9773e89c-0b52-439b-af64-c9088fd14197 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:24.651883 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-9773e89c-0b52-439b-af64-c9088fd14197 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050350 Jul 15 20:40:24.652462 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 251/506] 10.222.0.66 () {58 vars in 1301 bytes} [Fri Jul 15 20:40:24 2022] GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:40:25.459103 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-d58d3b37-2f5d-4f1e-b9e0-74a372eb3fbb tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:25.460129 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-d58d3b37-2f5d-4f1e-b9e0-74a372eb3fbb tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:25.467023 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d58d3b37-2f5d-4f1e-b9e0-74a372eb3fbb tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:25.467478 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d58d3b37-2f5d-4f1e-b9e0-74a372eb3fbb tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:25.468251 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d58d3b37-2f5d-4f1e-b9e0-74a372eb3fbb tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:25.468723 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d58d3b37-2f5d-4f1e-b9e0-74a372eb3fbb tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:25.605871 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-d58d3b37-2f5d-4f1e-b9e0-74a372eb3fbb tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d12a685d9b419fa3606b5f4d1309fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af209f962144de4ae7e3575a3890096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:25.614282 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-d58d3b37-2f5d-4f1e-b9e0-74a372eb3fbb tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e" status: 200 len: 1721 microversion: 2.1 time: 0.159047 Jul 15 20:40:25.614842 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 256/507] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:25 2022] GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:40:25.663206 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-5de6dd7c-f406-479d-ae03-1748547685a1 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:25.664143 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-5de6dd7c-f406-479d-ae03-1748547685a1 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: f45998cc-d9ed-4dd5-acf0-caba5d56696d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:25.671570 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5de6dd7c-f406-479d-ae03-1748547685a1 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:25.672014 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5de6dd7c-f406-479d-ae03-1748547685a1 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:25.672843 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5de6dd7c-f406-479d-ae03-1748547685a1 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:25.673272 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5de6dd7c-f406-479d-ae03-1748547685a1 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:25.697379 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:40:25.702393 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-5de6dd7c-f406-479d-ae03-1748547685a1 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043176 Jul 15 20:40:25.702955 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 252/508] 10.222.0.66 () {58 vars in 1301 bytes} [Fri Jul 15 20:40:25 2022] GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:40:26.631346 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-80ccb674-80db-49da-8112-46a7bea5d431 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:26.631955 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-80ccb674-80db-49da-8112-46a7bea5d431 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:26.638999 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-80ccb674-80db-49da-8112-46a7bea5d431 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:26.639441 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-80ccb674-80db-49da-8112-46a7bea5d431 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:26.640205 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-80ccb674-80db-49da-8112-46a7bea5d431 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:26.640668 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-80ccb674-80db-49da-8112-46a7bea5d431 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:26.713889 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-738d10fa-b005-4e08-9f77-7dc9e335e9fb tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:26.714850 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-738d10fa-b005-4e08-9f77-7dc9e335e9fb tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: f45998cc-d9ed-4dd5-acf0-caba5d56696d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:26.722865 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-738d10fa-b005-4e08-9f77-7dc9e335e9fb tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:26.723309 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-738d10fa-b005-4e08-9f77-7dc9e335e9fb tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:26.724066 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-738d10fa-b005-4e08-9f77-7dc9e335e9fb tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:26.724524 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-738d10fa-b005-4e08-9f77-7dc9e335e9fb tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:26.756999 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-738d10fa-b005-4e08-9f77-7dc9e335e9fb tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047080 Jul 15 20:40:26.757576 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 253/509] 10.222.0.66 () {58 vars in 1301 bytes} [Fri Jul 15 20:40:26 2022] GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 20:40:26.777784 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-80ccb674-80db-49da-8112-46a7bea5d431 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d12a685d9b419fa3606b5f4d1309fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af209f962144de4ae7e3575a3890096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:26.787026 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-80ccb674-80db-49da-8112-46a7bea5d431 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e" status: 200 len: 1721 microversion: 2.1 time: 0.159343 Jul 15 20:40:26.787660 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 257/510] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:26 2022] GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:40:27.768947 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-7f413c10-f6f6-4a84-ae4c-1a38ce22d083 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:27.769869 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-7f413c10-f6f6-4a84-ae4c-1a38ce22d083 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: f45998cc-d9ed-4dd5-acf0-caba5d56696d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:27.776329 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7f413c10-f6f6-4a84-ae4c-1a38ce22d083 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:27.776805 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7f413c10-f6f6-4a84-ae4c-1a38ce22d083 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:27.777565 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7f413c10-f6f6-4a84-ae4c-1a38ce22d083 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:27.778004 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7f413c10-f6f6-4a84-ae4c-1a38ce22d083 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:27.805032 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-0ee3d01a-6e2c-47c2-9683-8b35ee37c539 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:27.805743 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-0ee3d01a-6e2c-47c2-9683-8b35ee37c539 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:27.807787 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-7f413c10-f6f6-4a84-ae4c-1a38ce22d083 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042894 Jul 15 20:40:27.808348 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 254/511] 10.222.0.66 () {58 vars in 1301 bytes} [Fri Jul 15 20:40:27 2022] GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:40:27.812911 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-0ee3d01a-6e2c-47c2-9683-8b35ee37c539 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:27.813344 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-0ee3d01a-6e2c-47c2-9683-8b35ee37c539 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:27.814107 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-0ee3d01a-6e2c-47c2-9683-8b35ee37c539 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:27.814537 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-0ee3d01a-6e2c-47c2-9683-8b35ee37c539 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:27.953667 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-0ee3d01a-6e2c-47c2-9683-8b35ee37c539 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d12a685d9b419fa3606b5f4d1309fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af209f962144de4ae7e3575a3890096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:27.961949 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-0ee3d01a-6e2c-47c2-9683-8b35ee37c539 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e" status: 200 len: 1721 microversion: 2.1 time: 0.160740 Jul 15 20:40:27.962500 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 258/512] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:27 2022] GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:40:28.820131 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-455727db-5764-4d44-8463-abd7cbf67510 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:28.821118 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-455727db-5764-4d44-8463-abd7cbf67510 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: f45998cc-d9ed-4dd5-acf0-caba5d56696d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:28.828089 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-455727db-5764-4d44-8463-abd7cbf67510 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:28.828573 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-455727db-5764-4d44-8463-abd7cbf67510 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:28.829335 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-455727db-5764-4d44-8463-abd7cbf67510 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:28.829773 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-455727db-5764-4d44-8463-abd7cbf67510 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:28.858574 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-455727db-5764-4d44-8463-abd7cbf67510 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042326 Jul 15 20:40:28.859123 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 255/513] 10.222.0.66 () {58 vars in 1301 bytes} [Fri Jul 15 20:40:28 2022] GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:40:28.979169 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-757d4caa-0ce3-4bf3-827c-858af263e33c tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:28.979837 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-757d4caa-0ce3-4bf3-827c-858af263e33c tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:28.986362 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-757d4caa-0ce3-4bf3-827c-858af263e33c tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:28.986812 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-757d4caa-0ce3-4bf3-827c-858af263e33c tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:28.987573 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-757d4caa-0ce3-4bf3-827c-858af263e33c tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:28.988010 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-757d4caa-0ce3-4bf3-827c-858af263e33c tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:29.121399 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-757d4caa-0ce3-4bf3-827c-858af263e33c tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d12a685d9b419fa3606b5f4d1309fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af209f962144de4ae7e3575a3890096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:29.130320 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-757d4caa-0ce3-4bf3-827c-858af263e33c tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e" status: 200 len: 1721 microversion: 2.1 time: 0.155194 Jul 15 20:40:29.130911 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 259/514] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:28 2022] GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:40:29.870401 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-fd6d85bb-c20a-4f37-9544-21a526c483b5 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:29.871231 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-fd6d85bb-c20a-4f37-9544-21a526c483b5 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: f45998cc-d9ed-4dd5-acf0-caba5d56696d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:29.877842 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fd6d85bb-c20a-4f37-9544-21a526c483b5 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:29.878267 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fd6d85bb-c20a-4f37-9544-21a526c483b5 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:29.879013 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fd6d85bb-c20a-4f37-9544-21a526c483b5 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:29.879439 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fd6d85bb-c20a-4f37-9544-21a526c483b5 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:29.909227 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-fd6d85bb-c20a-4f37-9544-21a526c483b5 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042831 Jul 15 20:40:29.909776 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 256/515] 10.222.0.66 () {58 vars in 1301 bytes} [Fri Jul 15 20:40:29 2022] GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:40:30.149975 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-69e64484-6a24-4eb1-bde7-5bc68c9257b0 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:30.150590 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-69e64484-6a24-4eb1-bde7-5bc68c9257b0 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:30.158232 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-69e64484-6a24-4eb1-bde7-5bc68c9257b0 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:30.158684 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-69e64484-6a24-4eb1-bde7-5bc68c9257b0 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:30.159455 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-69e64484-6a24-4eb1-bde7-5bc68c9257b0 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:30.159885 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-69e64484-6a24-4eb1-bde7-5bc68c9257b0 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:30.299677 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-69e64484-6a24-4eb1-bde7-5bc68c9257b0 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d12a685d9b419fa3606b5f4d1309fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af209f962144de4ae7e3575a3890096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:30.309276 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-69e64484-6a24-4eb1-bde7-5bc68c9257b0 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e" status: 200 len: 1698 microversion: 2.1 time: 0.165777 Jul 15 20:40:30.309955 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 260/516] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:30 2022] GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e => generated 1698 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:40:30.326054 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-436251a8-cc16-419d-b871-2f966604342c tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:40:30.332168 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-436251a8-cc16-419d-b871-2f966604342c tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:30.332652 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-436251a8-cc16-419d-b871-2f966604342c tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:30.354391 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-436251a8-cc16-419d-b871-2f966604342c tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e] Going to try to start instance {{(pid=124432) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 15 20:40:30.395937 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-436251a8-cc16-419d-b871-2f966604342c tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "POST /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e/action" status: 202 len: 0 microversion: 2.1 time: 0.073505 Jul 15 20:40:30.400053 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 257/517] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 15 20:40:30 2022] POST /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 20:40:30.412288 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-e57ad41d-9eb6-4c5c-8782-687a5646cf67 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:30.412975 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-e57ad41d-9eb6-4c5c-8782-687a5646cf67 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:30.422697 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e57ad41d-9eb6-4c5c-8782-687a5646cf67 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:30.423299 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e57ad41d-9eb6-4c5c-8782-687a5646cf67 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:30.424848 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e57ad41d-9eb6-4c5c-8782-687a5646cf67 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:30.428040 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e57ad41d-9eb6-4c5c-8782-687a5646cf67 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:30.552488 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-bcf9872a-4ffd-4339-9b69-2192f9057bf5 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:30.553349 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-bcf9872a-4ffd-4339-9b69-2192f9057bf5 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] [instance: 67ed2b36-9422-4f98-8a39-83c214eadae9] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:30.562771 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-bcf9872a-4ffd-4339-9b69-2192f9057bf5 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:30.568793 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-bcf9872a-4ffd-4339-9b69-2192f9057bf5 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:30.569888 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-bcf9872a-4ffd-4339-9b69-2192f9057bf5 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:30.570722 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-bcf9872a-4ffd-4339-9b69-2192f9057bf5 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:30.603687 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-e57ad41d-9eb6-4c5c-8782-687a5646cf67 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d12a685d9b419fa3606b5f4d1309fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af209f962144de4ae7e3575a3890096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:30.615297 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-e57ad41d-9eb6-4c5c-8782-687a5646cf67 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e" status: 200 len: 1707 microversion: 2.1 time: 0.213850 Jul 15 20:40:30.616599 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 261/518] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:30 2022] GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e => generated 1707 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:40:30.760722 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-bcf9872a-4ffd-4339-9b69-2192f9057bf5 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a573525d244ab3ab69095db8871f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d62130d6f74b8e919e429cbb3afc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:30.770033 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-bcf9872a-4ffd-4339-9b69-2192f9057bf5 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] 10.222.0.66 "GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9" status: 200 len: 1594 microversion: 2.1 time: 0.222065 Jul 15 20:40:30.770598 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 258/519] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:30 2022] GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9 => generated 1594 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:40:30.921979 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-8d3bf860-9e02-4549-a1f5-02f9a7793861 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:30.922971 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-8d3bf860-9e02-4549-a1f5-02f9a7793861 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: f45998cc-d9ed-4dd5-acf0-caba5d56696d] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:30.928960 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8d3bf860-9e02-4549-a1f5-02f9a7793861 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:30.929399 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8d3bf860-9e02-4549-a1f5-02f9a7793861 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:30.930165 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8d3bf860-9e02-4549-a1f5-02f9a7793861 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:30.930815 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8d3bf860-9e02-4549-a1f5-02f9a7793861 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:30.964952 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-8d3bf860-9e02-4549-a1f5-02f9a7793861 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047749 Jul 15 20:40:30.965703 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 262/520] 10.222.0.66 () {58 vars in 1301 bytes} [Fri Jul 15 20:40:30 2022] GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 15 20:40:31.029135 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-ced6cc63-3689-4109-bb52-0e8bab15161f tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:31.030304 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-ced6cc63-3689-4109-bb52-0e8bab15161f tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: f45998cc-d9ed-4dd5-acf0-caba5d56696d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:31.037414 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ced6cc63-3689-4109-bb52-0e8bab15161f tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:31.037862 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ced6cc63-3689-4109-bb52-0e8bab15161f tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:31.038621 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ced6cc63-3689-4109-bb52-0e8bab15161f tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:31.039046 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ced6cc63-3689-4109-bb52-0e8bab15161f tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:31.067298 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-ced6cc63-3689-4109-bb52-0e8bab15161f tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: f45998cc-d9ed-4dd5-acf0-caba5d56696d] Going to try to terminate instance {{(pid=124432) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 20:40:31.154871 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-ced6cc63-3689-4109-bb52-0e8bab15161f tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "DELETE /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d" status: 204 len: 0 microversion: 2.1 time: 0.129072 Jul 15 20:40:31.155909 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 259/521] 10.222.0.66 () {58 vars in 1238 bytes} [Fri Jul 15 20:40:31 2022] DELETE /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 20:40:31.165297 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-1407b4a8-b25f-4302-87d6-2e1ba0019a78 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:31.165935 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-1407b4a8-b25f-4302-87d6-2e1ba0019a78 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: f45998cc-d9ed-4dd5-acf0-caba5d56696d] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:31.173486 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-1407b4a8-b25f-4302-87d6-2e1ba0019a78 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:31.173868 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-1407b4a8-b25f-4302-87d6-2e1ba0019a78 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:31.174677 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-1407b4a8-b25f-4302-87d6-2e1ba0019a78 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:31.175142 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-1407b4a8-b25f-4302-87d6-2e1ba0019a78 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:31.389569 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-1407b4a8-b25f-4302-87d6-2e1ba0019a78 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:31.396778 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-1407b4a8-b25f-4302-87d6-2e1ba0019a78 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d" status: 200 len: 1680 microversion: 2.1 time: 0.236598 Jul 15 20:40:31.397370 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 263/522] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:31 2022] GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d => generated 1680 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:40:31.641982 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-ca2ac2c0-b783-4fbb-8e60-cfd6477db67b tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:31.642684 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-ca2ac2c0-b783-4fbb-8e60-cfd6477db67b tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:31.648767 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ca2ac2c0-b783-4fbb-8e60-cfd6477db67b tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:31.649224 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ca2ac2c0-b783-4fbb-8e60-cfd6477db67b tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:31.649995 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ca2ac2c0-b783-4fbb-8e60-cfd6477db67b tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:31.650433 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ca2ac2c0-b783-4fbb-8e60-cfd6477db67b tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:31.875552 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-ca2ac2c0-b783-4fbb-8e60-cfd6477db67b tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d12a685d9b419fa3606b5f4d1309fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af209f962144de4ae7e3575a3890096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:31.883635 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-ca2ac2c0-b783-4fbb-8e60-cfd6477db67b tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e" status: 200 len: 1707 microversion: 2.1 time: 0.246583 Jul 15 20:40:31.884209 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 260/523] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:31 2022] GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e => generated 1707 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:40:32.414085 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-3d86e054-e38f-465b-9bb2-373216c8ca69 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:32.414684 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-3d86e054-e38f-465b-9bb2-373216c8ca69 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: f45998cc-d9ed-4dd5-acf0-caba5d56696d] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:32.421802 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-3d86e054-e38f-465b-9bb2-373216c8ca69 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:32.422249 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-3d86e054-e38f-465b-9bb2-373216c8ca69 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:32.423016 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-3d86e054-e38f-465b-9bb2-373216c8ca69 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:32.423453 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-3d86e054-e38f-465b-9bb2-373216c8ca69 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:32.615414 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-3d86e054-e38f-465b-9bb2-373216c8ca69 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:32.622781 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-3d86e054-e38f-465b-9bb2-373216c8ca69 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d" status: 200 len: 1680 microversion: 2.1 time: 0.212449 Jul 15 20:40:32.623429 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 264/524] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:32 2022] GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d => generated 1680 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:40:32.821513 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-db337f35-93b8-4e79-8eac-8a0282e7b68b tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:32.822410 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-db337f35-93b8-4e79-8eac-8a0282e7b68b tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] [instance: 96e9395e-e62c-4127-b56d-435ef3dcb839] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:32.831187 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-db337f35-93b8-4e79-8eac-8a0282e7b68b tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:32.831764 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-db337f35-93b8-4e79-8eac-8a0282e7b68b tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:32.832838 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-db337f35-93b8-4e79-8eac-8a0282e7b68b tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:32.833346 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-db337f35-93b8-4e79-8eac-8a0282e7b68b tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:32.901584 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-ef524f4e-b527-4697-b183-0dc4e7dd4ea5 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:32.902608 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-ef524f4e-b527-4697-b183-0dc4e7dd4ea5 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:32.910212 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-ef524f4e-b527-4697-b183-0dc4e7dd4ea5 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:32.911039 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-ef524f4e-b527-4697-b183-0dc4e7dd4ea5 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:32.912893 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-ef524f4e-b527-4697-b183-0dc4e7dd4ea5 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:32.913570 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-ef524f4e-b527-4697-b183-0dc4e7dd4ea5 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:32.991651 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.objects.instance [None req-db337f35-93b8-4e79-8eac-8a0282e7b68b tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lazy-loading 'services' on Instance uuid 96e9395e-e62c-4127-b56d-435ef3dcb839 {{(pid=124432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 20:40:33.141223 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-db337f35-93b8-4e79-8eac-8a0282e7b68b tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] 10.222.0.66 "DELETE /compute/v2.1/servers/96e9395e-e62c-4127-b56d-435ef3dcb839/os-volume_attachments/cc720eb3-785f-4287-8fb5-000acb46548a" status: 202 len: 0 microversion: 2.1 time: 0.323123 Jul 15 20:40:33.142149 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 261/525] 10.222.0.66 () {58 vars in 1415 bytes} [Fri Jul 15 20:40:32 2022] DELETE /compute/v2.1/servers/96e9395e-e62c-4127-b56d-435ef3dcb839/os-volume_attachments/cc720eb3-785f-4287-8fb5-000acb46548a => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 20:40:33.149718 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-1ea6edf6-dcc7-429d-96cb-13b03f45f9a8 req-499d7a67-25f0-4f75-aa6d-af45361afba7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67ed2b36-9422-4f98-8a39-83c214eadae9", "tag": "138653ff-cbaa-43a2-9358-b327bc394857"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:40:33.150718 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-ef524f4e-b527-4697-b183-0dc4e7dd4ea5 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d12a685d9b419fa3606b5f4d1309fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af209f962144de4ae7e3575a3890096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:33.161055 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-1ea6edf6-dcc7-429d-96cb-13b03f45f9a8 req-499d7a67-25f0-4f75-aa6d-af45361afba7 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:33.161853 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-1ea6edf6-dcc7-429d-96cb-13b03f45f9a8 req-499d7a67-25f0-4f75-aa6d-af45361afba7 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:33.178547 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-ef524f4e-b527-4697-b183-0dc4e7dd4ea5 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e" status: 200 len: 1707 microversion: 2.1 time: 0.278437 Jul 15 20:40:33.180439 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 265/526] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:32 2022] GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e => generated 1707 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:40:33.189854 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-1ea6edf6-dcc7-429d-96cb-13b03f45f9a8 req-499d7a67-25f0-4f75-aa6d-af45361afba7 service nova] Creating event network-changed:138653ff-cbaa-43a2-9358-b327bc394857 for instance 67ed2b36-9422-4f98-8a39-83c214eadae9 on hv-cinder-79987 Jul 15 20:40:33.197603 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-1ea6edf6-dcc7-429d-96cb-13b03f45f9a8 req-499d7a67-25f0-4f75-aa6d-af45361afba7 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053134 Jul 15 20:40:33.198627 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 262/527] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:40:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:40:33.640313 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-0c562a39-c6f3-468c-aa6a-22f5328786f1 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:33.641133 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-0c562a39-c6f3-468c-aa6a-22f5328786f1 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: f45998cc-d9ed-4dd5-acf0-caba5d56696d] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:33.648641 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-0c562a39-c6f3-468c-aa6a-22f5328786f1 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:33.649085 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-0c562a39-c6f3-468c-aa6a-22f5328786f1 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:33.649871 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-0c562a39-c6f3-468c-aa6a-22f5328786f1 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:33.650305 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-0c562a39-c6f3-468c-aa6a-22f5328786f1 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:33.812035 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-e96b1fdc-2732-45d3-8423-24f863234da2 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-213788905", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-203258470", "security_groups": [{"name": "tempest-secgroup-smoke-329834501"}], "networks": [{"uuid": "12174c62-16c5-4771-ab6f-597cb48dad04"}], "block_device_mapping_v2": [{"uuid": "2c0587e8-4e15-49cc-85f0-b636761d26d8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:40:33.826612 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-0c562a39-c6f3-468c-aa6a-22f5328786f1 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:33.834808 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-0c562a39-c6f3-468c-aa6a-22f5328786f1 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d" status: 200 len: 1680 microversion: 2.1 time: 0.198320 Jul 15 20:40:33.835936 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 266/528] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:33 2022] GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d => generated 1680 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:40:33.963918 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.network.neutron [None req-e96b1fdc-2732-45d3-8423-24f863234da2 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] validate_networks() for [('12174c62-16c5-4771-ab6f-597cb48dad04', None, None, None, None, None)] {{(pid=124432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 20:40:34.187388 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:40:34.196923 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-c46f42c7-7f75-40f1-b2da-66702f968b9f tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:34.198039 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-c46f42c7-7f75-40f1-b2da-66702f968b9f tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:34.206567 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c46f42c7-7f75-40f1-b2da-66702f968b9f tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:34.207043 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c46f42c7-7f75-40f1-b2da-66702f968b9f tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:34.207820 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c46f42c7-7f75-40f1-b2da-66702f968b9f tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:34.208256 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c46f42c7-7f75-40f1-b2da-66702f968b9f tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:34.455932 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-c46f42c7-7f75-40f1-b2da-66702f968b9f tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d12a685d9b419fa3606b5f4d1309fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af209f962144de4ae7e3575a3890096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:34.466532 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-c46f42c7-7f75-40f1-b2da-66702f968b9f tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e" status: 200 len: 1711 microversion: 2.1 time: 0.273288 Jul 15 20:40:34.469745 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 267/529] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:34 2022] GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e => generated 1711 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:40:34.478051 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-32053099-4a10-4e24-ba7a-8208956588e5 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-754581922"}} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:40:34.478599 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-32053099-4a10-4e24-ba7a-8208956588e5 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] [instance: 67ed2b36-9422-4f98-8a39-83c214eadae9] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:34.479514 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-e96b1fdc-2732-45d3-8423-24f863234da2 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Flavor limits 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 20:40:34.479931 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-e96b1fdc-2732-45d3-8423-24f863234da2 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Image limits 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 20:40:34.480618 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-e96b1fdc-2732-45d3-8423-24f863234da2 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Flavor pref 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 20:40:34.481085 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-e96b1fdc-2732-45d3-8423-24f863234da2 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Image pref 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 20:40:34.481490 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-e96b1fdc-2732-45d3-8423-24f863234da2 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 20:40:34.485082 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-32053099-4a10-4e24-ba7a-8208956588e5 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:34.485539 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-32053099-4a10-4e24-ba7a-8208956588e5 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:34.486327 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-32053099-4a10-4e24-ba7a-8208956588e5 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:34.486765 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-32053099-4a10-4e24-ba7a-8208956588e5 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:34.491267 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e96b1fdc-2732-45d3-8423-24f863234da2 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:34.491892 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e96b1fdc-2732-45d3-8423-24f863234da2 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:34.492899 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e96b1fdc-2732-45d3-8423-24f863234da2 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:34.493501 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e96b1fdc-2732-45d3-8423-24f863234da2 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:34.511010 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-e96b1fdc-2732-45d3-8423-24f863234da2 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Getting quotas for project 13e1593c67704dbbafad13310ca35448. Resources: {'instances', 'ram', 'cores'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 20:40:34.516423 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-e96b1fdc-2732-45d3-8423-24f863234da2 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Getting quotas for user e2e27fccbf854a8b8c9d6d099893f783 and project 13e1593c67704dbbafad13310ca35448. Resources: {'instances', 'ram', 'cores'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 20:40:34.595481 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-e96b1fdc-2732-45d3-8423-24f863234da2 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Going to run 1 instances... {{(pid=124432) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 20:40:34.599523 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-e96b1fdc-2732-45d3-8423-24f863234da2 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] [instance: b02f18ea-fd0b-4edd-97a7-17621ab67c8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2c0587e8-4e15-49cc-85f0-b636761d26d8',volume_size=None,volume_type=None)] {{(pid=124432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 20:40:34.661368 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.network.security_group_api [None req-32053099-4a10-4e24-ba7a-8208956588e5 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Adding security group b1b8b8cf-53aa-45af-b149-b9442acb5e5b to port 138653ff-cbaa-43a2-9358-b327bc394857 Jul 15 20:40:34.771357 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-e96b1fdc-2732-45d3-8423-24f863234da2 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.964470 Jul 15 20:40:34.777446 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 263/530] 10.222.0.66 () {60 vars in 1146 bytes} [Fri Jul 15 20:40:33 2022] POST /compute/v2.1/servers => generated 405 bytes in 971 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 15 20:40:34.783251 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-9128ee87-a691-4089-9cef-419b893fff88 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:34.784195 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-9128ee87-a691-4089-9cef-419b893fff88 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] [instance: b02f18ea-fd0b-4edd-97a7-17621ab67c8f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:34.882234 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-9128ee87-a691-4089-9cef-419b893fff88 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e27fccbf854a8b8c9d6d099893f783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e1593c67704dbbafad13310ca35448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:34.892335 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-9128ee87-a691-4089-9cef-419b893fff88 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] 10.222.0.66 "GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f" status: 200 len: 1087 microversion: 2.1 time: 0.113315 Jul 15 20:40:34.893326 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 264/531] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:34 2022] GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f => generated 1087 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:40:34.910610 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-3f0c3926-1128-4a9f-9861-44d492aede51 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:34.912004 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-3f0c3926-1128-4a9f-9861-44d492aede51 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: f45998cc-d9ed-4dd5-acf0-caba5d56696d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:34.928543 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3f0c3926-1128-4a9f-9861-44d492aede51 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:34.929125 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3f0c3926-1128-4a9f-9861-44d492aede51 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:34.930160 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3f0c3926-1128-4a9f-9861-44d492aede51 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:34.931567 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3f0c3926-1128-4a9f-9861-44d492aede51 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:35.200566 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-3f0c3926-1128-4a9f-9861-44d492aede51 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:35.210405 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-3f0c3926-1128-4a9f-9861-44d492aede51 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d" status: 200 len: 1680 microversion: 2.1 time: 0.305686 Jul 15 20:40:35.211275 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 265/532] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:34 2022] GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d => generated 1680 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:40:35.337981 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-32053099-4a10-4e24-ba7a-8208956588e5 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] 10.222.0.66 "POST /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9/action" status: 202 len: 0 microversion: 2.1 time: 0.866270 Jul 15 20:40:35.343630 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 268/533] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 15 20:40:34 2022] POST /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9/action => generated 0 bytes in 873 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 20:40:35.348894 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-8f0bb4e3-9b29-4c0f-a845-22eafa7ef22b tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:35.349513 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-8f0bb4e3-9b29-4c0f-a845-22eafa7ef22b tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] [instance: 67ed2b36-9422-4f98-8a39-83c214eadae9] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:35.357011 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-07a60af3-1df9-4396-a13b-541f8783cc1c tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:35.359306 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8f0bb4e3-9b29-4c0f-a845-22eafa7ef22b tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:35.359455 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-07a60af3-1df9-4396-a13b-541f8783cc1c tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] [instance: 96e9395e-e62c-4127-b56d-435ef3dcb839] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:35.359764 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8f0bb4e3-9b29-4c0f-a845-22eafa7ef22b tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:35.360582 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8f0bb4e3-9b29-4c0f-a845-22eafa7ef22b tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:35.361021 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8f0bb4e3-9b29-4c0f-a845-22eafa7ef22b tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:35.371725 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-07a60af3-1df9-4396-a13b-541f8783cc1c tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:35.373501 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-07a60af3-1df9-4396-a13b-541f8783cc1c tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:35.373501 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-07a60af3-1df9-4396-a13b-541f8783cc1c tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:35.376307 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-07a60af3-1df9-4396-a13b-541f8783cc1c tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:35.432161 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-07a60af3-1df9-4396-a13b-541f8783cc1c tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] [instance: 96e9395e-e62c-4127-b56d-435ef3dcb839] Going to try to terminate instance {{(pid=124430) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 20:40:35.507896 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_cell1:SELECT=100 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:40:35.600730 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-8f0bb4e3-9b29-4c0f-a845-22eafa7ef22b tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a573525d244ab3ab69095db8871f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d62130d6f74b8e919e429cbb3afc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:35.608348 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-07a60af3-1df9-4396-a13b-541f8783cc1c tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] 10.222.0.66 "DELETE /compute/v2.1/servers/96e9395e-e62c-4127-b56d-435ef3dcb839" status: 204 len: 0 microversion: 2.1 time: 0.257080 Jul 15 20:40:35.609546 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 269/534] 10.222.0.66 () {58 vars in 1238 bytes} [Fri Jul 15 20:40:35 2022] DELETE /compute/v2.1/servers/96e9395e-e62c-4127-b56d-435ef3dcb839 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 20:40:35.615289 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [req-b87a7983-4dff-4412-ad1a-1c5260314950 req-4cb9b504-2b62-489d-b2d9-ca8ea89de3c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67ed2b36-9422-4f98-8a39-83c214eadae9", "tag": "138653ff-cbaa-43a2-9358-b327bc394857"}]} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:40:35.616523 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-8f0bb4e3-9b29-4c0f-a845-22eafa7ef22b tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] 10.222.0.66 "GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9" status: 200 len: 1640 microversion: 2.1 time: 0.271237 Jul 15 20:40:35.628417 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 266/535] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:35 2022] GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9 => generated 1640 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:40:35.635815 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-d0b15abb-b3c1-4de1-830e-b64c2122c03a tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:35.637936 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-d0b15abb-b3c1-4de1-830e-b64c2122c03a tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] [instance: 96e9395e-e62c-4127-b56d-435ef3dcb839] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:35.648825 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d0b15abb-b3c1-4de1-830e-b64c2122c03a tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:35.649423 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d0b15abb-b3c1-4de1-830e-b64c2122c03a tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:35.652307 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d0b15abb-b3c1-4de1-830e-b64c2122c03a tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:35.654247 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d0b15abb-b3c1-4de1-830e-b64c2122c03a tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:35.656348 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-b87a7983-4dff-4412-ad1a-1c5260314950 req-4cb9b504-2b62-489d-b2d9-ca8ea89de3c9 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:35.656838 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-b87a7983-4dff-4412-ad1a-1c5260314950 req-4cb9b504-2b62-489d-b2d9-ca8ea89de3c9 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:35.684792 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.compute.server_external_events [req-b87a7983-4dff-4412-ad1a-1c5260314950 req-4cb9b504-2b62-489d-b2d9-ca8ea89de3c9 service nova] Creating event network-changed:138653ff-cbaa-43a2-9358-b327bc394857 for instance 67ed2b36-9422-4f98-8a39-83c214eadae9 on hv-cinder-79987 Jul 15 20:40:35.692291 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [req-b87a7983-4dff-4412-ad1a-1c5260314950 req-4cb9b504-2b62-489d-b2d9-ca8ea89de3c9 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081107 Jul 15 20:40:35.693222 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 270/536] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:40:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:40:35.827315 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-d0b15abb-b3c1-4de1-830e-b64c2122c03a tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145cee1016d349ceb93323a170bc957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f9e0f8edb42848965b3c6141e88d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:35.839227 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [req-9de0da7c-8b58-4771-933f-137f1af102bf req-33eb347b-3975-4d14-a1a4-b0e692ad95c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f45998cc-d9ed-4dd5-acf0-caba5d56696d", "name": "network-vif-deleted", "tag": "af14f3e2-18e6-4ff3-b57f-afda50ef445b"}]} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:40:35.845224 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-d0b15abb-b3c1-4de1-830e-b64c2122c03a tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] 10.222.0.66 "GET /compute/v2.1/servers/96e9395e-e62c-4127-b56d-435ef3dcb839" status: 200 len: 1514 microversion: 2.1 time: 0.226559 Jul 15 20:40:35.854671 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 267/537] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:35 2022] GET /compute/v2.1/servers/96e9395e-e62c-4127-b56d-435ef3dcb839 => generated 1514 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:40:35.855929 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-9de0da7c-8b58-4771-933f-137f1af102bf req-33eb347b-3975-4d14-a1a4-b0e692ad95c8 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:35.856379 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-9de0da7c-8b58-4771-933f-137f1af102bf req-33eb347b-3975-4d14-a1a4-b0e692ad95c8 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:35.868051 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.compute.server_external_events [req-9de0da7c-8b58-4771-933f-137f1af102bf req-33eb347b-3975-4d14-a1a4-b0e692ad95c8 service nova] Creating event network-vif-deleted:af14f3e2-18e6-4ff3-b57f-afda50ef445b for instance f45998cc-d9ed-4dd5-acf0-caba5d56696d on hv-cinder-79987 Jul 15 20:40:35.874022 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [req-9de0da7c-8b58-4771-933f-137f1af102bf req-33eb347b-3975-4d14-a1a4-b0e692ad95c8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038785 Jul 15 20:40:35.874623 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 271/538] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:40:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:40:35.910249 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-131ce357-db08-4dcd-9e99-c0033511d48e tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:35.911390 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-131ce357-db08-4dcd-9e99-c0033511d48e tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] [instance: b02f18ea-fd0b-4edd-97a7-17621ab67c8f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:35.918119 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-131ce357-db08-4dcd-9e99-c0033511d48e tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:35.918819 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-131ce357-db08-4dcd-9e99-c0033511d48e tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:35.919765 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-131ce357-db08-4dcd-9e99-c0033511d48e tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:35.921271 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-131ce357-db08-4dcd-9e99-c0033511d48e tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:35.943437 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:40:35.994479 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-131ce357-db08-4dcd-9e99-c0033511d48e tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e27fccbf854a8b8c9d6d099893f783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e1593c67704dbbafad13310ca35448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:36.005459 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-131ce357-db08-4dcd-9e99-c0033511d48e tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] 10.222.0.66 "GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f" status: 200 len: 1129 microversion: 2.1 time: 0.098949 Jul 15 20:40:36.006053 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 268/539] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:35 2022] GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f => generated 1129 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:40:36.229005 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-012d24d4-c905-4329-9e41-faf7968c6770 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:36.229704 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-012d24d4-c905-4329-9e41-faf7968c6770 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: f45998cc-d9ed-4dd5-acf0-caba5d56696d] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:36.236962 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-012d24d4-c905-4329-9e41-faf7968c6770 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:36.237413 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-012d24d4-c905-4329-9e41-faf7968c6770 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:36.238188 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-012d24d4-c905-4329-9e41-faf7968c6770 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:36.238622 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-012d24d4-c905-4329-9e41-faf7968c6770 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:36.304185 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-012d24d4-c905-4329-9e41-faf7968c6770 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:36.312359 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-012d24d4-c905-4329-9e41-faf7968c6770 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d" status: 200 len: 1613 microversion: 2.1 time: 0.087758 Jul 15 20:40:36.312952 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 272/540] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:36 2022] GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d => generated 1613 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:40:36.863678 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-e6047fae-e2a8-4978-bcc5-4b402bb89356 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:36.864416 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-e6047fae-e2a8-4978-bcc5-4b402bb89356 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] [instance: 96e9395e-e62c-4127-b56d-435ef3dcb839] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:36.871011 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e6047fae-e2a8-4978-bcc5-4b402bb89356 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:36.871527 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e6047fae-e2a8-4978-bcc5-4b402bb89356 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:36.872356 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e6047fae-e2a8-4978-bcc5-4b402bb89356 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:36.872900 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e6047fae-e2a8-4978-bcc5-4b402bb89356 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:37.005397 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-e6047fae-e2a8-4978-bcc5-4b402bb89356 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145cee1016d349ceb93323a170bc957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f9e0f8edb42848965b3c6141e88d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:37.012833 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-e6047fae-e2a8-4978-bcc5-4b402bb89356 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] 10.222.0.66 "GET /compute/v2.1/servers/96e9395e-e62c-4127-b56d-435ef3dcb839" status: 200 len: 1514 microversion: 2.1 time: 0.152964 Jul 15 20:40:37.013391 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 269/541] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:36 2022] GET /compute/v2.1/servers/96e9395e-e62c-4127-b56d-435ef3dcb839 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:40:37.023318 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-96ca2afc-b9e5-4b1c-af4e-9782fd29f8e3 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:37.023914 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-96ca2afc-b9e5-4b1c-af4e-9782fd29f8e3 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] [instance: b02f18ea-fd0b-4edd-97a7-17621ab67c8f] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:37.031589 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-96ca2afc-b9e5-4b1c-af4e-9782fd29f8e3 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:37.032026 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-96ca2afc-b9e5-4b1c-af4e-9782fd29f8e3 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:37.032825 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-96ca2afc-b9e5-4b1c-af4e-9782fd29f8e3 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:37.033252 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-96ca2afc-b9e5-4b1c-af4e-9782fd29f8e3 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:37.099459 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-96ca2afc-b9e5-4b1c-af4e-9782fd29f8e3 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e27fccbf854a8b8c9d6d099893f783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e1593c67704dbbafad13310ca35448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:37.107047 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-96ca2afc-b9e5-4b1c-af4e-9782fd29f8e3 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] 10.222.0.66 "GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f" status: 200 len: 1129 microversion: 2.1 time: 0.087654 Jul 15 20:40:37.111839 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 273/542] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:37 2022] GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f => generated 1129 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:40:37.329629 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-dced4e7d-d7bd-469b-b59e-1c6c88792eb2 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:37.330124 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-dced4e7d-d7bd-469b-b59e-1c6c88792eb2 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: f45998cc-d9ed-4dd5-acf0-caba5d56696d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:37.336501 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-dced4e7d-d7bd-469b-b59e-1c6c88792eb2 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:37.337282 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-dced4e7d-d7bd-469b-b59e-1c6c88792eb2 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:37.338270 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-dced4e7d-d7bd-469b-b59e-1c6c88792eb2 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:37.338905 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-dced4e7d-d7bd-469b-b59e-1c6c88792eb2 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:37.407186 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-dced4e7d-d7bd-469b-b59e-1c6c88792eb2 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:37.414901 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-dced4e7d-d7bd-469b-b59e-1c6c88792eb2 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d" status: 200 len: 1326 microversion: 2.1 time: 0.089494 Jul 15 20:40:37.419856 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 270/543] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:37 2022] GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d => generated 1326 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:40:38.030600 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-8693e646-bdd8-46b8-a30f-13fa16f021c2 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:38.031180 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-8693e646-bdd8-46b8-a30f-13fa16f021c2 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] [instance: 96e9395e-e62c-4127-b56d-435ef3dcb839] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:38.037714 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8693e646-bdd8-46b8-a30f-13fa16f021c2 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:38.038167 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8693e646-bdd8-46b8-a30f-13fa16f021c2 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:38.038926 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8693e646-bdd8-46b8-a30f-13fa16f021c2 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:38.039372 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8693e646-bdd8-46b8-a30f-13fa16f021c2 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:38.124987 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-42010fc9-b1da-469f-ab3a-c54e54c19e9c tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:38.126213 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-42010fc9-b1da-469f-ab3a-c54e54c19e9c tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] [instance: b02f18ea-fd0b-4edd-97a7-17621ab67c8f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:38.135716 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-42010fc9-b1da-469f-ab3a-c54e54c19e9c tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:38.137008 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-42010fc9-b1da-469f-ab3a-c54e54c19e9c tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:38.137887 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-42010fc9-b1da-469f-ab3a-c54e54c19e9c tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:38.138394 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-42010fc9-b1da-469f-ab3a-c54e54c19e9c tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:38.231431 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-8693e646-bdd8-46b8-a30f-13fa16f021c2 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145cee1016d349ceb93323a170bc957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f9e0f8edb42848965b3c6141e88d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:38.235359 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-42010fc9-b1da-469f-ab3a-c54e54c19e9c tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e27fccbf854a8b8c9d6d099893f783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e1593c67704dbbafad13310ca35448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:38.240021 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-8693e646-bdd8-46b8-a30f-13fa16f021c2 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] 10.222.0.66 "GET /compute/v2.1/servers/96e9395e-e62c-4127-b56d-435ef3dcb839" status: 200 len: 1514 microversion: 2.1 time: 0.213887 Jul 15 20:40:38.240963 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 274/544] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:38 2022] GET /compute/v2.1/servers/96e9395e-e62c-4127-b56d-435ef3dcb839 => generated 1514 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:40:38.245483 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-42010fc9-b1da-469f-ab3a-c54e54c19e9c tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] 10.222.0.66 "GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f" status: 200 len: 1185 microversion: 2.1 time: 0.124261 Jul 15 20:40:38.257323 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 271/545] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:38 2022] GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f => generated 1185 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:40:38.434236 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-0251e812-8b0e-4510-89f7-447fbb79952c tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:38.435184 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-0251e812-8b0e-4510-89f7-447fbb79952c tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: f45998cc-d9ed-4dd5-acf0-caba5d56696d] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:38.447518 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-0251e812-8b0e-4510-89f7-447fbb79952c tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:38.448471 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-0251e812-8b0e-4510-89f7-447fbb79952c tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:38.449329 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-0251e812-8b0e-4510-89f7-447fbb79952c tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:38.449836 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-0251e812-8b0e-4510-89f7-447fbb79952c tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:38.469214 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.wsgi [None req-0251e812-8b0e-4510-89f7-447fbb79952c tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] HTTP exception thrown: Instance f45998cc-d9ed-4dd5-acf0-caba5d56696d could not be found. Jul 15 20:40:38.470936 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-0251e812-8b0e-4510-89f7-447fbb79952c tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Request method failure captured: Jul 15 20:40:38.470936 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: request: GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d HTTP/1.1 Jul 15 20:40:38.470936 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Accept: application/json Jul 15 20:40:38.470936 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Accept-Encoding: identity Jul 15 20:40:38.470936 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Connection: close Jul 15 20:40:38.470936 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Content-Length: 0 Jul 15 20:40:38.470936 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Content-Type: application/json Jul 15 20:40:38.470936 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Host: 10.222.0.66 Jul 15 20:40:38.470936 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Openstack-System-Scope: None Jul 15 20:40:38.470936 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: User-Agent: python-urllib3/1.26.9 Jul 15 20:40:38.470936 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Auth-Token: gAAAAABi0c_kH9ys3aP35h1LWWw3r1ieyA8CI0v0WIPPxjHmBB6aGubC4LmfLrm23mJ8HvmdkzR7wDAmSNK2w9OIr-gnn6Blv4WbaRzcu_QA8HGYGiqbz987b1vb5xUWoBYf2fTfD1m5oPgbP0g7S9YRfksUIFxkz4MW4lkoTMD9FFmUr-jPyfM Jul 15 20:40:38.470936 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Domain-Id: None Jul 15 20:40:38.470936 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Domain-Name: None Jul 15 20:40:38.470936 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Identity-Status: Confirmed Jul 15 20:40:38.470936 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Is-Admin-Project: True Jul 15 20:40:38.470936 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Domain-Id: default Jul 15 20:40:38.470936 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Domain-Name: Default Jul 15 20:40:38.470936 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Id: 78a593e163e74a7b9db61133e5c22035 Jul 15 20:40:38.470936 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Name: tempest-AttachVolumeNegativeTest-846080947 Jul 15 20:40:38.470936 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Role: member,reader Jul 15 20:40:38.470936 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Roles: member,reader Jul 15 20:40:38.472547 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/78a593e163e74a7b9db61133e5c22035"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_78a593e163e74a7b9db61133e5c22035"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/78a593e163e74a7b9db61133e5c22035"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/78a593e163e74a7b9db61133e5c22035"}]}] Jul 15 20:40:38.472547 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant: tempest-AttachVolumeNegativeTest-846080947 Jul 15 20:40:38.472547 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant-Id: 78a593e163e74a7b9db61133e5c22035 Jul 15 20:40:38.472547 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-846080947 Jul 15 20:40:38.472547 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User: tempest-AttachVolumeNegativeTest-846080947-project Jul 15 20:40:38.472547 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Domain-Id: default Jul 15 20:40:38.472547 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Domain-Name: Default Jul 15 20:40:38.472547 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Id: c0b5962b37b2470099436609425f7423 Jul 15 20:40:38.472547 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Name: tempest-AttachVolumeNegativeTest-846080947-project Jul 15 20:40:38.472547 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: method: > Jul 15 20:40:38.472547 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: exception: Instance f45998cc-d9ed-4dd5-acf0-caba5d56696d could not be found. Jul 15 20:40:38.472547 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: action_args: {'id': 'f45998cc-d9ed-4dd5-acf0-caba5d56696d'} Jul 15 20:40:38.473306 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 20:40:38.473306 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:40:38.473306 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 20:40:38.473306 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 20:40:38.473306 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 20:40:38.473306 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 20:40:38.473306 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 20:40:38.473306 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 20:40:38.473306 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 20:40:38.473306 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 20:40:38.473306 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f45998cc-d9ed-4dd5-acf0-caba5d56696d could not be found. Jul 15 20:40:38.473306 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:40:38.473306 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:40:38.473306 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:40:38.473306 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:40:38.473306 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:40:38.473306 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:40:38.473306 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 20:40:38.473306 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 20:40:38.473306 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 20:40:38.474580 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 20:40:38.474580 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 20:40:38.474580 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 20:40:38.474580 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 20:40:38.474580 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 20:40:38.474580 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 20:40:38.474580 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 20:40:38.474580 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f45998cc-d9ed-4dd5-acf0-caba5d56696d could not be found. Jul 15 20:40:38.474580 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:40:38.474580 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:40:38.474580 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:40:38.474580 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:40:38.474580 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:40:38.474580 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:40:38.474580 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 20:40:38.474580 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 20:40:38.474580 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f45998cc-d9ed-4dd5-acf0-caba5d56696d could not be found. Jul 15 20:40:38.474580 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:40:38.476613 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-0251e812-8b0e-4510-89f7-447fbb79952c tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Returning 404 to user: Instance f45998cc-d9ed-4dd5-acf0-caba5d56696d could not be found. {{(pid=124430) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 20:40:38.476613 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-0251e812-8b0e-4510-89f7-447fbb79952c tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d" status: 404 len: 111 microversion: 2.1 time: 0.044829 Jul 15 20:40:38.476613 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 275/546] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:38 2022] GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 20:40:38.482802 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-6ec9bb60-9e6e-4a9f-9303-3097525b60dd tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '.version_select at 0x7ff51849c0d0>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:38.501698 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-6ec9bb60-9e6e-4a9f-9303-3097525b60dd tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-971365333" status: 202 len: 0 microversion: 2.1 time: 0.022838 Jul 15 20:40:38.502283 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 272/547] 10.222.0.66 () {58 vars in 1217 bytes} [Fri Jul 15 20:40:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-971365333 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 20:40:39.231172 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-a9c20b7e-bc19-4987-9997-75f3e7e600cb tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Action: 'create', calling method: .version_select at 0x7ff5182715e0>, body: {"keypair": {"name": "tempest-keypair-863849489", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOey4xPzNfKqbpT4qeAxosTbv54mb0Yfbx459hJ4aMt/NVFSeLmAfpCncxB7qX6zOSAVwU2BU0Il3CedVY521vPHOHfQD0gne13gJFh3nGve4i2HRnU/Hb9Q1FBpSeKR4Q=="}} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:40:39.257462 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.quota [None req-a9c20b7e-bc19-4987-9997-75f3e7e600cb tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Getting quotas for project 78a593e163e74a7b9db61133e5c22035. Resources: {'key_pairs'} {{(pid=124430) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 20:40:39.259474 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-2f7a63ea-e8ef-42cd-b892-557cd153e754 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:39.260077 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-2f7a63ea-e8ef-42cd-b892-557cd153e754 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] [instance: 96e9395e-e62c-4127-b56d-435ef3dcb839] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:39.265032 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.quota [None req-a9c20b7e-bc19-4987-9997-75f3e7e600cb tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Getting quotas for user c0b5962b37b2470099436609425f7423 and project 78a593e163e74a7b9db61133e5c22035. Resources: {'key_pairs'} {{(pid=124430) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 20:40:39.268974 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2f7a63ea-e8ef-42cd-b892-557cd153e754 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:39.269422 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2f7a63ea-e8ef-42cd-b892-557cd153e754 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:39.270382 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2f7a63ea-e8ef-42cd-b892-557cd153e754 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:39.271004 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2f7a63ea-e8ef-42cd-b892-557cd153e754 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:39.296656 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-a9c20b7e-bc19-4987-9997-75f3e7e600cb tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.074331 Jul 15 20:40:39.297519 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 276/548] 10.222.0.66 () {60 vars in 1158 bytes} [Fri Jul 15 20:40:39 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:40:39.315777 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-9cab975b-5f2a-40f4-9d8c-97d9248080d7 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:39.316774 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-9cab975b-5f2a-40f4-9d8c-97d9248080d7 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] [instance: b02f18ea-fd0b-4edd-97a7-17621ab67c8f] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:39.325772 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-9cab975b-5f2a-40f4-9d8c-97d9248080d7 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:39.326550 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-9cab975b-5f2a-40f4-9d8c-97d9248080d7 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:39.327542 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-9cab975b-5f2a-40f4-9d8c-97d9248080d7 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:39.328100 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-9cab975b-5f2a-40f4-9d8c-97d9248080d7 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:39.361039 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-2f7a63ea-e8ef-42cd-b892-557cd153e754 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145cee1016d349ceb93323a170bc957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f9e0f8edb42848965b3c6141e88d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:39.370721 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-2f7a63ea-e8ef-42cd-b892-557cd153e754 tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] 10.222.0.66 "GET /compute/v2.1/servers/96e9395e-e62c-4127-b56d-435ef3dcb839" status: 200 len: 1472 microversion: 2.1 time: 0.117453 Jul 15 20:40:39.371395 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 273/549] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:39 2022] GET /compute/v2.1/servers/96e9395e-e62c-4127-b56d-435ef3dcb839 => generated 1472 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:40:39.406393 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-9cab975b-5f2a-40f4-9d8c-97d9248080d7 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e27fccbf854a8b8c9d6d099893f783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e1593c67704dbbafad13310ca35448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:39.414493 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-9cab975b-5f2a-40f4-9d8c-97d9248080d7 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] 10.222.0.66 "GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f" status: 200 len: 1191 microversion: 2.1 time: 0.116119 Jul 15 20:40:39.415064 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 277/550] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:39 2022] GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f => generated 1191 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:40:39.479247 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-377f4860-cd69-48f2-a34a-c64e045d2a10 req-dd3b9ff6-bb91-4a6c-866e-95eae33acb28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96e9395e-e62c-4127-b56d-435ef3dcb839", "name": "network-vif-deleted", "tag": "38f9e10c-b8ff-4602-a5f7-f0aa2f8e09be"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:40:39.494175 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-377f4860-cd69-48f2-a34a-c64e045d2a10 req-dd3b9ff6-bb91-4a6c-866e-95eae33acb28 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:39.494857 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-377f4860-cd69-48f2-a34a-c64e045d2a10 req-dd3b9ff6-bb91-4a6c-866e-95eae33acb28 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:39.521466 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-377f4860-cd69-48f2-a34a-c64e045d2a10 req-dd3b9ff6-bb91-4a6c-866e-95eae33acb28 service nova] Creating event network-vif-deleted:38f9e10c-b8ff-4602-a5f7-f0aa2f8e09be for instance 96e9395e-e62c-4127-b56d-435ef3dcb839 on hv-cinder-79987 Jul 15 20:40:39.527505 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-377f4860-cd69-48f2-a34a-c64e045d2a10 req-dd3b9ff6-bb91-4a6c-866e-95eae33acb28 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058101 Jul 15 20:40:39.529074 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 274/551] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:40:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:40:40.389291 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-aff78a1f-bfde-4d82-9ba3-e90b8b7b617f tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:40.391456 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-aff78a1f-bfde-4d82-9ba3-e90b8b7b617f tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] [instance: 96e9395e-e62c-4127-b56d-435ef3dcb839] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:40.399053 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-aff78a1f-bfde-4d82-9ba3-e90b8b7b617f tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:40.401829 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-aff78a1f-bfde-4d82-9ba3-e90b8b7b617f tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:40.402878 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-aff78a1f-bfde-4d82-9ba3-e90b8b7b617f tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:40.403629 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-aff78a1f-bfde-4d82-9ba3-e90b8b7b617f tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:40.421005 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.wsgi [None req-aff78a1f-bfde-4d82-9ba3-e90b8b7b617f tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] HTTP exception thrown: Instance 96e9395e-e62c-4127-b56d-435ef3dcb839 could not be found. Jul 15 20:40:40.422883 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-aff78a1f-bfde-4d82-9ba3-e90b8b7b617f tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Request method failure captured: Jul 15 20:40:40.422883 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: request: GET /compute/v2.1/servers/96e9395e-e62c-4127-b56d-435ef3dcb839 HTTP/1.1 Jul 15 20:40:40.422883 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Accept: application/json Jul 15 20:40:40.422883 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Accept-Encoding: identity Jul 15 20:40:40.422883 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Connection: close Jul 15 20:40:40.422883 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Content-Length: 0 Jul 15 20:40:40.422883 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Content-Type: application/json Jul 15 20:40:40.422883 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Host: 10.222.0.66 Jul 15 20:40:40.422883 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Openstack-System-Scope: None Jul 15 20:40:40.422883 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: User-Agent: python-urllib3/1.26.9 Jul 15 20:40:40.422883 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Auth-Token: gAAAAABi0dA4I1xga-jLCh5y1GiPRuXSG3JiWJdIZfgo1h7g9LInspUzOmWBrdvntrPYBtfrnJYhXDL07Lg_A7VS9LCGIzglUrEhbBQE3wSEDKXlLHbeFj94wgMNHdarWF9bnKCw8D1TfsTbvn14lOwW00SBniyIr4umcFcfxCdoeBXC_VhWUU0 Jul 15 20:40:40.422883 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Domain-Id: None Jul 15 20:40:40.422883 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Domain-Name: None Jul 15 20:40:40.422883 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Identity-Status: Confirmed Jul 15 20:40:40.422883 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Is-Admin-Project: True Jul 15 20:40:40.422883 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Domain-Id: default Jul 15 20:40:40.422883 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Domain-Name: Default Jul 15 20:40:40.422883 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Id: 1e9f9e0f8edb42848965b3c6141e88d0 Jul 15 20:40:40.422883 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Name: tempest-VolumesSnapshotTestJSON-38155707 Jul 15 20:40:40.422883 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Role: member,reader Jul 15 20:40:40.422883 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Roles: member,reader Jul 15 20:40:40.424597 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1e9f9e0f8edb42848965b3c6141e88d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_1e9f9e0f8edb42848965b3c6141e88d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1e9f9e0f8edb42848965b3c6141e88d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/1e9f9e0f8edb42848965b3c6141e88d0"}]}] Jul 15 20:40:40.424597 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant: tempest-VolumesSnapshotTestJSON-38155707 Jul 15 20:40:40.424597 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant-Id: 1e9f9e0f8edb42848965b3c6141e88d0 Jul 15 20:40:40.424597 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-38155707 Jul 15 20:40:40.424597 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User: tempest-VolumesSnapshotTestJSON-38155707-project Jul 15 20:40:40.424597 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Domain-Id: default Jul 15 20:40:40.424597 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Domain-Name: Default Jul 15 20:40:40.424597 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Id: 145cee1016d349ceb93323a170bc957e Jul 15 20:40:40.424597 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Name: tempest-VolumesSnapshotTestJSON-38155707-project Jul 15 20:40:40.424597 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: method: > Jul 15 20:40:40.424597 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: exception: Instance 96e9395e-e62c-4127-b56d-435ef3dcb839 could not be found. Jul 15 20:40:40.424597 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: action_args: {'id': '96e9395e-e62c-4127-b56d-435ef3dcb839'} Jul 15 20:40:40.425463 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 20:40:40.425463 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:40:40.425463 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 20:40:40.425463 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 20:40:40.425463 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 20:40:40.425463 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 20:40:40.425463 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 20:40:40.425463 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 20:40:40.425463 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 20:40:40.425463 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 20:40:40.425463 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96e9395e-e62c-4127-b56d-435ef3dcb839 could not be found. Jul 15 20:40:40.425463 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:40:40.425463 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:40:40.425463 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:40:40.425463 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:40:40.425463 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:40:40.425463 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:40:40.425463 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 20:40:40.425463 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 20:40:40.425463 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 20:40:40.426635 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 20:40:40.426635 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 20:40:40.426635 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 20:40:40.426635 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 20:40:40.426635 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 20:40:40.426635 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 20:40:40.426635 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 20:40:40.426635 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96e9395e-e62c-4127-b56d-435ef3dcb839 could not be found. Jul 15 20:40:40.426635 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:40:40.426635 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:40:40.426635 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:40:40.426635 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:40:40.426635 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:40:40.426635 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:40:40.426635 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 20:40:40.426635 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 20:40:40.426635 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96e9395e-e62c-4127-b56d-435ef3dcb839 could not be found. Jul 15 20:40:40.426635 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:40:40.428433 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-aff78a1f-bfde-4d82-9ba3-e90b8b7b617f tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] Returning 404 to user: Instance 96e9395e-e62c-4127-b56d-435ef3dcb839 could not be found. {{(pid=124430) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 20:40:40.429293 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-aff78a1f-bfde-4d82-9ba3-e90b8b7b617f tempest-VolumesSnapshotTestJSON-38155707 tempest-VolumesSnapshotTestJSON-38155707-project] 10.222.0.66 "GET /compute/v2.1/servers/96e9395e-e62c-4127-b56d-435ef3dcb839" status: 404 len: 111 microversion: 2.1 time: 0.044409 Jul 15 20:40:40.430074 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 278/552] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:40 2022] GET /compute/v2.1/servers/96e9395e-e62c-4127-b56d-435ef3dcb839 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 20:40:40.432677 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-20a8c2e4-22c6-4cee-9bcd-0e0c7965a7b6 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:40.433397 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-20a8c2e4-22c6-4cee-9bcd-0e0c7965a7b6 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] [instance: b02f18ea-fd0b-4edd-97a7-17621ab67c8f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:40.449119 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-20a8c2e4-22c6-4cee-9bcd-0e0c7965a7b6 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:40.449119 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-20a8c2e4-22c6-4cee-9bcd-0e0c7965a7b6 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:40.449119 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-20a8c2e4-22c6-4cee-9bcd-0e0c7965a7b6 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:40.449575 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-20a8c2e4-22c6-4cee-9bcd-0e0c7965a7b6 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:40.725582 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-20a8c2e4-22c6-4cee-9bcd-0e0c7965a7b6 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e27fccbf854a8b8c9d6d099893f783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e1593c67704dbbafad13310ca35448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:40.738411 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-20a8c2e4-22c6-4cee-9bcd-0e0c7965a7b6 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] 10.222.0.66 "GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f" status: 200 len: 1258 microversion: 2.1 time: 0.309308 Jul 15 20:40:40.740073 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 275/553] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:40 2022] GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f => generated 1258 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:40:40.988193 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-99c73b4e-e1f6-435b-91f1-38ebad510795 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-758365480", "imageRef": "a759604a-67e3-4c79-b848-5d03d936d7a0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f64ae9a9-bcaf-4115-89a7-71a9ec023719"}], "security_groups": [{"name": "tempest-securitygroup--1273776922"}], "key_name": "tempest-keypair-863849489", "user_data": "}} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:40:41.096540 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.network.neutron [None req-99c73b4e-e1f6-435b-91f1-38ebad510795 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] validate_networks() for [('f64ae9a9-bcaf-4115-89a7-71a9ec023719', None, None, None, None, None)] {{(pid=124430) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 20:40:41.473270 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.virt.hardware [None req-99c73b4e-e1f6-435b-91f1-38ebad510795 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Flavor limits 0:0:0 {{(pid=124430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 20:40:41.473797 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.virt.hardware [None req-99c73b4e-e1f6-435b-91f1-38ebad510795 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Image limits 0:0:0 {{(pid=124430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 20:40:41.474210 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.virt.hardware [None req-99c73b4e-e1f6-435b-91f1-38ebad510795 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Flavor pref 0:0:0 {{(pid=124430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 20:40:41.474617 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.virt.hardware [None req-99c73b4e-e1f6-435b-91f1-38ebad510795 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Image pref 0:0:0 {{(pid=124430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 20:40:41.475025 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.virt.hardware [None req-99c73b4e-e1f6-435b-91f1-38ebad510795 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 20:40:41.484646 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-99c73b4e-e1f6-435b-91f1-38ebad510795 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:41.485099 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-99c73b4e-e1f6-435b-91f1-38ebad510795 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:41.485899 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-99c73b4e-e1f6-435b-91f1-38ebad510795 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:41.486337 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-99c73b4e-e1f6-435b-91f1-38ebad510795 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:41.504097 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.quota [None req-99c73b4e-e1f6-435b-91f1-38ebad510795 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Getting quotas for project 78a593e163e74a7b9db61133e5c22035. Resources: {'instances', 'ram', 'cores'} {{(pid=124430) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 20:40:41.508088 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.quota [None req-99c73b4e-e1f6-435b-91f1-38ebad510795 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Getting quotas for user c0b5962b37b2470099436609425f7423 and project 78a593e163e74a7b9db61133e5c22035. Resources: {'instances', 'ram', 'cores'} {{(pid=124430) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 20:40:41.510502 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:40:41.522529 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-99c73b4e-e1f6-435b-91f1-38ebad510795 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Going to run 1 instances... {{(pid=124430) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 20:40:41.525213 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-99c73b4e-e1f6-435b-91f1-38ebad510795 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 4ffccc9e-10cc-413f-ac60-518d6541968a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a759604a-67e3-4c79-b848-5d03d936d7a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124430) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 20:40:41.543797 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-d029f9f2-424b-4f63-bab7-6c37451aa5bf req-c4a2dd93-7ae3-4350-bbd1-7c69098aadf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b02f18ea-fd0b-4edd-97a7-17621ab67c8f", "tag": "dc16e8e1-450a-4c4e-9a65-56300299d066"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:40:41.553589 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-d029f9f2-424b-4f63-bab7-6c37451aa5bf req-c4a2dd93-7ae3-4350-bbd1-7c69098aadf8 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:41.554152 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-d029f9f2-424b-4f63-bab7-6c37451aa5bf req-c4a2dd93-7ae3-4350-bbd1-7c69098aadf8 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:41.566697 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-d029f9f2-424b-4f63-bab7-6c37451aa5bf req-c4a2dd93-7ae3-4350-bbd1-7c69098aadf8 service nova] Creating event network-changed:dc16e8e1-450a-4c4e-9a65-56300299d066 for instance b02f18ea-fd0b-4edd-97a7-17621ab67c8f on hv-cinder-79987 Jul 15 20:40:41.571365 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-d029f9f2-424b-4f63-bab7-6c37451aa5bf req-c4a2dd93-7ae3-4350-bbd1-7c69098aadf8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031570 Jul 15 20:40:41.571942 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 276/554] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:40:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 20:40:41.578778 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-99c73b4e-e1f6-435b-91f1-38ebad510795 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.595087 Jul 15 20:40:41.579414 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 279/555] 10.222.0.66 () {60 vars in 1146 bytes} [Fri Jul 15 20:40:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 596 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 20:40:41.590914 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-4afb511e-533c-41f0-9fe5-7347f4695cbe tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:41.592880 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-4afb511e-533c-41f0-9fe5-7347f4695cbe tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 4ffccc9e-10cc-413f-ac60-518d6541968a] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:41.655330 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-4afb511e-533c-41f0-9fe5-7347f4695cbe tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:41.663285 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-4afb511e-533c-41f0-9fe5-7347f4695cbe tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/4ffccc9e-10cc-413f-ac60-518d6541968a" status: 200 len: 1240 microversion: 2.1 time: 0.077522 Jul 15 20:40:41.663862 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 277/556] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:41 2022] GET /compute/v2.1/servers/4ffccc9e-10cc-413f-ac60-518d6541968a => generated 1240 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:40:41.759128 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-e1b6ff2e-1085-433a-924a-9a6cd34d9802 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:41.759869 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-e1b6ff2e-1085-433a-924a-9a6cd34d9802 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] [instance: b02f18ea-fd0b-4edd-97a7-17621ab67c8f] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:41.767130 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e1b6ff2e-1085-433a-924a-9a6cd34d9802 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:41.767576 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e1b6ff2e-1085-433a-924a-9a6cd34d9802 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:41.768340 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e1b6ff2e-1085-433a-924a-9a6cd34d9802 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:41.768837 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e1b6ff2e-1085-433a-924a-9a6cd34d9802 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:41.988975 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-e1b6ff2e-1085-433a-924a-9a6cd34d9802 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e27fccbf854a8b8c9d6d099893f783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e1593c67704dbbafad13310ca35448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:41.997332 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-e1b6ff2e-1085-433a-924a-9a6cd34d9802 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] 10.222.0.66 "GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f" status: 200 len: 1258 microversion: 2.1 time: 0.243844 Jul 15 20:40:41.998447 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 280/557] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:41 2022] GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f => generated 1258 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:40:42.680666 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-92c2a7ae-7b05-4485-b415-17f6cba8a742 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:42.681275 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-92c2a7ae-7b05-4485-b415-17f6cba8a742 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 4ffccc9e-10cc-413f-ac60-518d6541968a] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:42.688465 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-92c2a7ae-7b05-4485-b415-17f6cba8a742 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:42.688916 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-92c2a7ae-7b05-4485-b415-17f6cba8a742 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:42.689679 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-92c2a7ae-7b05-4485-b415-17f6cba8a742 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:42.690114 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-92c2a7ae-7b05-4485-b415-17f6cba8a742 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:42.750074 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-92c2a7ae-7b05-4485-b415-17f6cba8a742 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:42.757382 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-92c2a7ae-7b05-4485-b415-17f6cba8a742 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/4ffccc9e-10cc-413f-ac60-518d6541968a" status: 200 len: 1292 microversion: 2.1 time: 0.080611 Jul 15 20:40:42.757940 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 278/558] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:42 2022] GET /compute/v2.1/servers/4ffccc9e-10cc-413f-ac60-518d6541968a => generated 1292 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:40:43.015620 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-ad391655-fdce-4ba3-8c01-44a05fc34fad tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:43.016176 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-ad391655-fdce-4ba3-8c01-44a05fc34fad tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] [instance: b02f18ea-fd0b-4edd-97a7-17621ab67c8f] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:43.022750 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-ad391655-fdce-4ba3-8c01-44a05fc34fad tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:43.023203 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-ad391655-fdce-4ba3-8c01-44a05fc34fad tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:43.023967 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-ad391655-fdce-4ba3-8c01-44a05fc34fad tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:43.024425 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-ad391655-fdce-4ba3-8c01-44a05fc34fad tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:43.159923 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-ad391655-fdce-4ba3-8c01-44a05fc34fad tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e27fccbf854a8b8c9d6d099893f783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e1593c67704dbbafad13310ca35448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:43.167555 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-ad391655-fdce-4ba3-8c01-44a05fc34fad tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] 10.222.0.66 "GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f" status: 200 len: 1258 microversion: 2.1 time: 0.156456 Jul 15 20:40:43.168112 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 281/559] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:43 2022] GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f => generated 1258 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:40:43.776656 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-263f694a-f6c5-4141-ba3e-6e73ba246602 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:43.777203 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-263f694a-f6c5-4141-ba3e-6e73ba246602 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 4ffccc9e-10cc-413f-ac60-518d6541968a] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:43.784287 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-263f694a-f6c5-4141-ba3e-6e73ba246602 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:43.784770 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-263f694a-f6c5-4141-ba3e-6e73ba246602 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:43.785532 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-263f694a-f6c5-4141-ba3e-6e73ba246602 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:43.785970 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-263f694a-f6c5-4141-ba3e-6e73ba246602 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:43.846857 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-263f694a-f6c5-4141-ba3e-6e73ba246602 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:43.854143 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-263f694a-f6c5-4141-ba3e-6e73ba246602 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/4ffccc9e-10cc-413f-ac60-518d6541968a" status: 200 len: 1292 microversion: 2.1 time: 0.081486 Jul 15 20:40:43.854693 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 279/560] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:43 2022] GET /compute/v2.1/servers/4ffccc9e-10cc-413f-ac60-518d6541968a => generated 1292 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:40:44.184246 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-b40f3997-d2d0-4040-b45d-483eecb0e9b4 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:44.184878 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-b40f3997-d2d0-4040-b45d-483eecb0e9b4 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] [instance: b02f18ea-fd0b-4edd-97a7-17621ab67c8f] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:44.191964 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b40f3997-d2d0-4040-b45d-483eecb0e9b4 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:44.192416 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b40f3997-d2d0-4040-b45d-483eecb0e9b4 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:44.193173 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b40f3997-d2d0-4040-b45d-483eecb0e9b4 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:44.193601 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b40f3997-d2d0-4040-b45d-483eecb0e9b4 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:44.329342 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-b40f3997-d2d0-4040-b45d-483eecb0e9b4 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e27fccbf854a8b8c9d6d099893f783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e1593c67704dbbafad13310ca35448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:44.336655 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-b40f3997-d2d0-4040-b45d-483eecb0e9b4 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] 10.222.0.66 "GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f" status: 200 len: 1258 microversion: 2.1 time: 0.156203 Jul 15 20:40:44.337204 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 282/561] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:44 2022] GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:40:44.871463 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-afdd5abd-2cc2-43ac-9db6-e54d75eb6065 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:44.872137 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-afdd5abd-2cc2-43ac-9db6-e54d75eb6065 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 4ffccc9e-10cc-413f-ac60-518d6541968a] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:44.874730 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell0:SELECT=2 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:40:44.880795 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-afdd5abd-2cc2-43ac-9db6-e54d75eb6065 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:44.881280 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-afdd5abd-2cc2-43ac-9db6-e54d75eb6065 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:44.882041 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-afdd5abd-2cc2-43ac-9db6-e54d75eb6065 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:44.882469 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-afdd5abd-2cc2-43ac-9db6-e54d75eb6065 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:44.948250 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-afdd5abd-2cc2-43ac-9db6-e54d75eb6065 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:44.955803 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-afdd5abd-2cc2-43ac-9db6-e54d75eb6065 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/4ffccc9e-10cc-413f-ac60-518d6541968a" status: 200 len: 1300 microversion: 2.1 time: 0.088233 Jul 15 20:40:44.956369 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 280/562] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:44 2022] GET /compute/v2.1/servers/4ffccc9e-10cc-413f-ac60-518d6541968a => generated 1300 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:40:45.354100 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-79ff5b2e-a32c-46c7-a934-9ba54dc8683b tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:45.355007 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-79ff5b2e-a32c-46c7-a934-9ba54dc8683b tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] [instance: b02f18ea-fd0b-4edd-97a7-17621ab67c8f] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:45.362161 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-79ff5b2e-a32c-46c7-a934-9ba54dc8683b tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:45.362690 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-79ff5b2e-a32c-46c7-a934-9ba54dc8683b tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:45.363601 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-79ff5b2e-a32c-46c7-a934-9ba54dc8683b tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:45.364099 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-79ff5b2e-a32c-46c7-a934-9ba54dc8683b tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:45.503557 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-79ff5b2e-a32c-46c7-a934-9ba54dc8683b tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e27fccbf854a8b8c9d6d099893f783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e1593c67704dbbafad13310ca35448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:45.511267 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-79ff5b2e-a32c-46c7-a934-9ba54dc8683b tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] 10.222.0.66 "GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f" status: 200 len: 1258 microversion: 2.1 time: 0.161101 Jul 15 20:40:45.511753 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 283/563] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:45 2022] GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f => generated 1258 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:40:45.972986 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-e97d8632-ebf6-406c-9900-8f2baf161406 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:45.974167 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-e97d8632-ebf6-406c-9900-8f2baf161406 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 4ffccc9e-10cc-413f-ac60-518d6541968a] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:45.981169 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e97d8632-ebf6-406c-9900-8f2baf161406 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:45.981619 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e97d8632-ebf6-406c-9900-8f2baf161406 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:45.982888 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e97d8632-ebf6-406c-9900-8f2baf161406 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:45.983573 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e97d8632-ebf6-406c-9900-8f2baf161406 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:46.130628 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-e97d8632-ebf6-406c-9900-8f2baf161406 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:46.138683 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-e97d8632-ebf6-406c-9900-8f2baf161406 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/4ffccc9e-10cc-413f-ac60-518d6541968a" status: 200 len: 1366 microversion: 2.1 time: 0.169508 Jul 15 20:40:46.139268 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 281/564] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:45 2022] GET /compute/v2.1/servers/4ffccc9e-10cc-413f-ac60-518d6541968a => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:40:46.529756 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-c62be215-3e2a-433d-b9a9-01a73d434190 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:46.531510 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-c62be215-3e2a-433d-b9a9-01a73d434190 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] [instance: b02f18ea-fd0b-4edd-97a7-17621ab67c8f] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:46.543175 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c62be215-3e2a-433d-b9a9-01a73d434190 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:46.545474 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c62be215-3e2a-433d-b9a9-01a73d434190 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:46.546894 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c62be215-3e2a-433d-b9a9-01a73d434190 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:46.548093 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c62be215-3e2a-433d-b9a9-01a73d434190 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:46.814053 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-c62be215-3e2a-433d-b9a9-01a73d434190 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e27fccbf854a8b8c9d6d099893f783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e1593c67704dbbafad13310ca35448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:46.815720 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-4b44b3f1-3fab-45f1-bfc3-66cc4d8007c9 req-7bdd4bd8-49b2-43aa-9683-ad3dcec42fba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ffccc9e-10cc-413f-ac60-518d6541968a", "tag": "e830d7aa-cb37-4cb9-98b3-6e2ce9280079"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:40:46.824427 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-4b44b3f1-3fab-45f1-bfc3-66cc4d8007c9 req-7bdd4bd8-49b2-43aa-9683-ad3dcec42fba service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:46.825066 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-4b44b3f1-3fab-45f1-bfc3-66cc4d8007c9 req-7bdd4bd8-49b2-43aa-9683-ad3dcec42fba service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:46.838944 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-c62be215-3e2a-433d-b9a9-01a73d434190 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] 10.222.0.66 "GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f" status: 200 len: 1258 microversion: 2.1 time: 0.314239 Jul 15 20:40:46.839400 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-4b44b3f1-3fab-45f1-bfc3-66cc4d8007c9 req-7bdd4bd8-49b2-43aa-9683-ad3dcec42fba service nova] Creating event network-changed:e830d7aa-cb37-4cb9-98b3-6e2ce9280079 for instance 4ffccc9e-10cc-413f-ac60-518d6541968a on hv-cinder-79987 Jul 15 20:40:46.840485 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 284/565] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:46 2022] GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f => generated 1258 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:40:46.851339 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-4b44b3f1-3fab-45f1-bfc3-66cc4d8007c9 req-7bdd4bd8-49b2-43aa-9683-ad3dcec42fba service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040514 Jul 15 20:40:46.851965 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 282/566] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:40:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 20:40:47.155578 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-1330c9c2-9410-40e2-9ecc-4f1af2a5d8bd tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:47.156201 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-1330c9c2-9410-40e2-9ecc-4f1af2a5d8bd tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 4ffccc9e-10cc-413f-ac60-518d6541968a] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:47.162206 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-1330c9c2-9410-40e2-9ecc-4f1af2a5d8bd tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:47.162654 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-1330c9c2-9410-40e2-9ecc-4f1af2a5d8bd tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:47.163404 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-1330c9c2-9410-40e2-9ecc-4f1af2a5d8bd tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:47.163838 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-1330c9c2-9410-40e2-9ecc-4f1af2a5d8bd tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:47.295682 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-1330c9c2-9410-40e2-9ecc-4f1af2a5d8bd tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:47.303256 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-1330c9c2-9410-40e2-9ecc-4f1af2a5d8bd tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/4ffccc9e-10cc-413f-ac60-518d6541968a" status: 200 len: 1366 microversion: 2.1 time: 0.152119 Jul 15 20:40:47.303813 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 285/567] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:47 2022] GET /compute/v2.1/servers/4ffccc9e-10cc-413f-ac60-518d6541968a => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:40:47.867887 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-1d24becb-4711-4de5-8f1a-c465820f48de tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:47.878495 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-1d24becb-4711-4de5-8f1a-c465820f48de tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] [instance: b02f18ea-fd0b-4edd-97a7-17621ab67c8f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:47.878495 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1d24becb-4711-4de5-8f1a-c465820f48de tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:47.878495 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1d24becb-4711-4de5-8f1a-c465820f48de tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:47.878495 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1d24becb-4711-4de5-8f1a-c465820f48de tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:47.878896 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1d24becb-4711-4de5-8f1a-c465820f48de tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:48.063984 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-1d24becb-4711-4de5-8f1a-c465820f48de tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e27fccbf854a8b8c9d6d099893f783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e1593c67704dbbafad13310ca35448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:48.072264 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-1d24becb-4711-4de5-8f1a-c465820f48de tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] 10.222.0.66 "GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f" status: 200 len: 1258 microversion: 2.1 time: 0.218992 Jul 15 20:40:48.080442 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 283/568] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:47 2022] GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f => generated 1258 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:40:48.320669 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-b2ecb183-1135-476e-88e2-2b1ac9785c15 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:48.321283 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-b2ecb183-1135-476e-88e2-2b1ac9785c15 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 4ffccc9e-10cc-413f-ac60-518d6541968a] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:48.328561 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b2ecb183-1135-476e-88e2-2b1ac9785c15 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:48.329019 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b2ecb183-1135-476e-88e2-2b1ac9785c15 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:48.329820 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b2ecb183-1135-476e-88e2-2b1ac9785c15 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:48.330263 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b2ecb183-1135-476e-88e2-2b1ac9785c15 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:48.466803 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-b2ecb183-1135-476e-88e2-2b1ac9785c15 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:48.474653 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-b2ecb183-1135-476e-88e2-2b1ac9785c15 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/4ffccc9e-10cc-413f-ac60-518d6541968a" status: 200 len: 1366 microversion: 2.1 time: 0.158107 Jul 15 20:40:48.475472 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 286/569] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:48 2022] GET /compute/v2.1/servers/4ffccc9e-10cc-413f-ac60-518d6541968a => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:40:49.090452 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-16daf384-1b59-4b10-a603-736ab6a6f6e2 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:49.091094 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-16daf384-1b59-4b10-a603-736ab6a6f6e2 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] [instance: b02f18ea-fd0b-4edd-97a7-17621ab67c8f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:49.098830 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-16daf384-1b59-4b10-a603-736ab6a6f6e2 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:49.099281 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-16daf384-1b59-4b10-a603-736ab6a6f6e2 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:49.100413 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-16daf384-1b59-4b10-a603-736ab6a6f6e2 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:49.100848 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-16daf384-1b59-4b10-a603-736ab6a6f6e2 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:49.244373 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-16daf384-1b59-4b10-a603-736ab6a6f6e2 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e27fccbf854a8b8c9d6d099893f783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e1593c67704dbbafad13310ca35448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:49.252783 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-16daf384-1b59-4b10-a603-736ab6a6f6e2 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] 10.222.0.66 "GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f" status: 200 len: 1258 microversion: 2.1 time: 0.166292 Jul 15 20:40:49.253377 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 284/570] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:49 2022] GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f => generated 1258 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:40:49.492310 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-8e05b434-8d07-496f-9093-4a6153a9d48c tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:49.492952 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-8e05b434-8d07-496f-9093-4a6153a9d48c tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 4ffccc9e-10cc-413f-ac60-518d6541968a] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:49.500123 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8e05b434-8d07-496f-9093-4a6153a9d48c tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:49.500608 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8e05b434-8d07-496f-9093-4a6153a9d48c tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:49.501376 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8e05b434-8d07-496f-9093-4a6153a9d48c tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:49.501808 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8e05b434-8d07-496f-9093-4a6153a9d48c tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:49.863459 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-8e05b434-8d07-496f-9093-4a6153a9d48c tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:49.871232 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-8e05b434-8d07-496f-9093-4a6153a9d48c tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/4ffccc9e-10cc-413f-ac60-518d6541968a" status: 200 len: 1366 microversion: 2.1 time: 0.382703 Jul 15 20:40:49.871835 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 287/571] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:49 2022] GET /compute/v2.1/servers/4ffccc9e-10cc-413f-ac60-518d6541968a => generated 1366 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:40:50.269877 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-315a79d8-3445-4b1d-993c-0b3ffd13cb7e tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:50.270513 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-315a79d8-3445-4b1d-993c-0b3ffd13cb7e tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] [instance: b02f18ea-fd0b-4edd-97a7-17621ab67c8f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:50.277071 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-315a79d8-3445-4b1d-993c-0b3ffd13cb7e tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:50.277517 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-315a79d8-3445-4b1d-993c-0b3ffd13cb7e tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:50.278267 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-315a79d8-3445-4b1d-993c-0b3ffd13cb7e tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:50.278694 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-315a79d8-3445-4b1d-993c-0b3ffd13cb7e tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:50.414135 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-315a79d8-3445-4b1d-993c-0b3ffd13cb7e tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e27fccbf854a8b8c9d6d099893f783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e1593c67704dbbafad13310ca35448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:50.423270 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-315a79d8-3445-4b1d-993c-0b3ffd13cb7e tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] 10.222.0.66 "GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f" status: 200 len: 1258 microversion: 2.1 time: 0.157709 Jul 15 20:40:50.423843 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 285/572] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:50 2022] GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f => generated 1258 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:40:50.889102 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-a844bb78-7fd3-45e2-a879-4825fd2c94ad tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:50.889642 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-a844bb78-7fd3-45e2-a879-4825fd2c94ad tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 4ffccc9e-10cc-413f-ac60-518d6541968a] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:50.895916 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-a844bb78-7fd3-45e2-a879-4825fd2c94ad tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:50.896367 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-a844bb78-7fd3-45e2-a879-4825fd2c94ad tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:50.897142 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-a844bb78-7fd3-45e2-a879-4825fd2c94ad tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:50.897575 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-a844bb78-7fd3-45e2-a879-4825fd2c94ad tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:51.027355 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-a844bb78-7fd3-45e2-a879-4825fd2c94ad tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:51.034995 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-a844bb78-7fd3-45e2-a879-4825fd2c94ad tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/4ffccc9e-10cc-413f-ac60-518d6541968a" status: 200 len: 1366 microversion: 2.1 time: 0.150677 Jul 15 20:40:51.035563 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 288/573] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:50 2022] GET /compute/v2.1/servers/4ffccc9e-10cc-413f-ac60-518d6541968a => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:40:51.441041 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-20d8fa0b-f261-41a2-a2a1-ced5790d4217 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:51.441652 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-20d8fa0b-f261-41a2-a2a1-ced5790d4217 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] [instance: b02f18ea-fd0b-4edd-97a7-17621ab67c8f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:51.448193 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-20d8fa0b-f261-41a2-a2a1-ced5790d4217 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:51.448670 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-20d8fa0b-f261-41a2-a2a1-ced5790d4217 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:51.449516 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-20d8fa0b-f261-41a2-a2a1-ced5790d4217 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:51.450030 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-20d8fa0b-f261-41a2-a2a1-ced5790d4217 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:51.581199 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-20d8fa0b-f261-41a2-a2a1-ced5790d4217 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e27fccbf854a8b8c9d6d099893f783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e1593c67704dbbafad13310ca35448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:51.588666 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-20d8fa0b-f261-41a2-a2a1-ced5790d4217 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] 10.222.0.66 "GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f" status: 200 len: 1258 microversion: 2.1 time: 0.152142 Jul 15 20:40:51.589243 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 286/574] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:51 2022] GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f => generated 1258 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:40:52.052597 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-deda9c26-3fe4-4203-89ff-bafa73278aab tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:52.053240 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-deda9c26-3fe4-4203-89ff-bafa73278aab tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 4ffccc9e-10cc-413f-ac60-518d6541968a] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:52.055100 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_cell0:SELECT=2 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:40:52.055749 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_cell0:SELECT=10 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:40:52.063123 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-deda9c26-3fe4-4203-89ff-bafa73278aab tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:52.063573 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-deda9c26-3fe4-4203-89ff-bafa73278aab tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:52.064350 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-deda9c26-3fe4-4203-89ff-bafa73278aab tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:52.064829 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-deda9c26-3fe4-4203-89ff-bafa73278aab tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:52.204535 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-deda9c26-3fe4-4203-89ff-bafa73278aab tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:52.208047 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:40:52.214336 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-deda9c26-3fe4-4203-89ff-bafa73278aab tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/4ffccc9e-10cc-413f-ac60-518d6541968a" status: 200 len: 1366 microversion: 2.1 time: 0.165607 Jul 15 20:40:52.215294 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 289/575] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:52 2022] GET /compute/v2.1/servers/4ffccc9e-10cc-413f-ac60-518d6541968a => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:40:52.606965 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-bf6f9985-ca42-4eec-923f-20146383f917 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:52.608102 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-bf6f9985-ca42-4eec-923f-20146383f917 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] [instance: b02f18ea-fd0b-4edd-97a7-17621ab67c8f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:52.610094 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell0:SELECT=10 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:40:52.616220 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-bf6f9985-ca42-4eec-923f-20146383f917 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:52.616694 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-bf6f9985-ca42-4eec-923f-20146383f917 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:52.617483 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-bf6f9985-ca42-4eec-923f-20146383f917 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:52.617973 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-bf6f9985-ca42-4eec-923f-20146383f917 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:52.759711 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-bf6f9985-ca42-4eec-923f-20146383f917 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e27fccbf854a8b8c9d6d099893f783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e1593c67704dbbafad13310ca35448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:52.768419 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-bf6f9985-ca42-4eec-923f-20146383f917 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] 10.222.0.66 "GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f" status: 200 len: 1258 microversion: 2.1 time: 0.165270 Jul 15 20:40:52.769108 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 287/576] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:52 2022] GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f => generated 1258 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:40:52.891821 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [req-16c671bb-6c40-4c97-854c-bd5b0709ed61 req-a626c28a-c3bb-4703-b1e3-a822f2435196 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b02f18ea-fd0b-4edd-97a7-17621ab67c8f", "name": "network-vif-plugged", "status": "completed", "tag": "dc16e8e1-450a-4c4e-9a65-56300299d066"}]} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:40:52.902369 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-16c671bb-6c40-4c97-854c-bd5b0709ed61 req-a626c28a-c3bb-4703-b1e3-a822f2435196 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:52.902824 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-16c671bb-6c40-4c97-854c-bd5b0709ed61 req-a626c28a-c3bb-4703-b1e3-a822f2435196 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:52.915730 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.compute.server_external_events [req-16c671bb-6c40-4c97-854c-bd5b0709ed61 req-a626c28a-c3bb-4703-b1e3-a822f2435196 service nova] Creating event network-vif-plugged:dc16e8e1-450a-4c4e-9a65-56300299d066 for instance b02f18ea-fd0b-4edd-97a7-17621ab67c8f on hv-cinder-79987 Jul 15 20:40:52.921705 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [req-16c671bb-6c40-4c97-854c-bd5b0709ed61 req-a626c28a-c3bb-4703-b1e3-a822f2435196 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034876 Jul 15 20:40:52.922289 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 290/577] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:40:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 20:40:53.231357 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-cf58f9ac-65d4-4f0d-ad8f-1f627fc88bab tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:53.232571 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-cf58f9ac-65d4-4f0d-ad8f-1f627fc88bab tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 4ffccc9e-10cc-413f-ac60-518d6541968a] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:53.238601 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-cf58f9ac-65d4-4f0d-ad8f-1f627fc88bab tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:53.239046 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-cf58f9ac-65d4-4f0d-ad8f-1f627fc88bab tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:53.239803 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-cf58f9ac-65d4-4f0d-ad8f-1f627fc88bab tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:53.240229 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-cf58f9ac-65d4-4f0d-ad8f-1f627fc88bab tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:53.373522 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-cf58f9ac-65d4-4f0d-ad8f-1f627fc88bab tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:53.380918 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-cf58f9ac-65d4-4f0d-ad8f-1f627fc88bab tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/4ffccc9e-10cc-413f-ac60-518d6541968a" status: 200 len: 1366 microversion: 2.1 time: 0.153437 Jul 15 20:40:53.381487 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 288/578] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:53 2022] GET /compute/v2.1/servers/4ffccc9e-10cc-413f-ac60-518d6541968a => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:40:53.786334 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-4146f7d0-bb7b-4aa0-b6f4-6e33262cdaa3 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:53.786951 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-4146f7d0-bb7b-4aa0-b6f4-6e33262cdaa3 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] [instance: b02f18ea-fd0b-4edd-97a7-17621ab67c8f] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:53.795674 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-4146f7d0-bb7b-4aa0-b6f4-6e33262cdaa3 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:53.796119 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-4146f7d0-bb7b-4aa0-b6f4-6e33262cdaa3 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:53.797121 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-4146f7d0-bb7b-4aa0-b6f4-6e33262cdaa3 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:53.797543 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-4146f7d0-bb7b-4aa0-b6f4-6e33262cdaa3 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:53.945101 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-4146f7d0-bb7b-4aa0-b6f4-6e33262cdaa3 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e27fccbf854a8b8c9d6d099893f783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e1593c67704dbbafad13310ca35448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:53.952806 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-4146f7d0-bb7b-4aa0-b6f4-6e33262cdaa3 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] 10.222.0.66 "GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f" status: 200 len: 1258 microversion: 2.1 time: 0.170676 Jul 15 20:40:53.953383 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 291/579] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:53 2022] GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f => generated 1258 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:40:54.399065 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-3ffc2c57-2b68-4e9e-b0c0-4eab8162fcac tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:54.399665 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-3ffc2c57-2b68-4e9e-b0c0-4eab8162fcac tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 4ffccc9e-10cc-413f-ac60-518d6541968a] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:54.406990 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3ffc2c57-2b68-4e9e-b0c0-4eab8162fcac tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:54.407429 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3ffc2c57-2b68-4e9e-b0c0-4eab8162fcac tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:54.408180 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3ffc2c57-2b68-4e9e-b0c0-4eab8162fcac tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:54.408630 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3ffc2c57-2b68-4e9e-b0c0-4eab8162fcac tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:54.412598 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell1:SELECT=100 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:40:54.537416 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-3ffc2c57-2b68-4e9e-b0c0-4eab8162fcac tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:54.545156 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-3ffc2c57-2b68-4e9e-b0c0-4eab8162fcac tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/4ffccc9e-10cc-413f-ac60-518d6541968a" status: 200 len: 1366 microversion: 2.1 time: 0.149889 Jul 15 20:40:54.545729 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 289/580] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:54 2022] GET /compute/v2.1/servers/4ffccc9e-10cc-413f-ac60-518d6541968a => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:40:54.929692 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-11209c10-f2d5-433c-8f45-4f97267f1fcf tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5c5590bb-68e6-4803-8751-f4e5c10fae38"}} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:40:54.931316 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-11209c10-f2d5-433c-8f45-4f97267f1fcf tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 943a9a49-4fcd-46a5-b444-1a94f490ae2e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:54.948029 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-11209c10-f2d5-433c-8f45-4f97267f1fcf tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:54.948500 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-11209c10-f2d5-433c-8f45-4f97267f1fcf tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:54.949285 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-11209c10-f2d5-433c-8f45-4f97267f1fcf tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:54.958024 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-11209c10-f2d5-433c-8f45-4f97267f1fcf tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:54.972217 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-6e794a2e-bb8d-4346-b616-a601b31b5b7b tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:54.973246 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-6e794a2e-bb8d-4346-b616-a601b31b5b7b tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] [instance: b02f18ea-fd0b-4edd-97a7-17621ab67c8f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:54.980864 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6e794a2e-bb8d-4346-b616-a601b31b5b7b tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:54.981530 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6e794a2e-bb8d-4346-b616-a601b31b5b7b tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:54.982889 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6e794a2e-bb8d-4346-b616-a601b31b5b7b tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:54.983324 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6e794a2e-bb8d-4346-b616-a601b31b5b7b tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:55.139966 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-6e794a2e-bb8d-4346-b616-a601b31b5b7b tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e27fccbf854a8b8c9d6d099893f783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e1593c67704dbbafad13310ca35448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:55.147495 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-6e794a2e-bb8d-4346-b616-a601b31b5b7b tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] 10.222.0.66 "GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f" status: 200 len: 1258 microversion: 2.1 time: 0.180946 Jul 15 20:40:55.148067 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 290/581] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:54 2022] GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f => generated 1258 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:40:55.259970 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-11209c10-f2d5-433c-8f45-4f97267f1fcf tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "POST /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.334192 Jul 15 20:40:55.260565 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 292/582] 10.222.0.66 () {60 vars in 1322 bytes} [Fri Jul 15 20:40:54 2022] POST /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e/os-volume_attachments => generated 194 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 20:40:55.563179 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-ba7d1793-7e1b-4fac-8b1e-ec1b0636f2df tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:55.563740 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-ba7d1793-7e1b-4fac-8b1e-ec1b0636f2df tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 4ffccc9e-10cc-413f-ac60-518d6541968a] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:55.570005 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ba7d1793-7e1b-4fac-8b1e-ec1b0636f2df tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:55.570449 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ba7d1793-7e1b-4fac-8b1e-ec1b0636f2df tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:55.571210 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ba7d1793-7e1b-4fac-8b1e-ec1b0636f2df tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:55.571644 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ba7d1793-7e1b-4fac-8b1e-ec1b0636f2df tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:55.708105 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-ba7d1793-7e1b-4fac-8b1e-ec1b0636f2df tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:55.715895 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-ba7d1793-7e1b-4fac-8b1e-ec1b0636f2df tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/4ffccc9e-10cc-413f-ac60-518d6541968a" status: 200 len: 1366 microversion: 2.1 time: 0.157533 Jul 15 20:40:55.716624 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 291/583] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:55 2022] GET /compute/v2.1/servers/4ffccc9e-10cc-413f-ac60-518d6541968a => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:40:55.843063 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [req-b2ff3547-48f4-4271-9e49-be770737b860 req-97d21e1d-9250-40a3-8f02-971fc9e49221 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ffccc9e-10cc-413f-ac60-518d6541968a", "name": "network-vif-plugged", "status": "completed", "tag": "e830d7aa-cb37-4cb9-98b3-6e2ce9280079"}]} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:40:55.854318 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-b2ff3547-48f4-4271-9e49-be770737b860 req-97d21e1d-9250-40a3-8f02-971fc9e49221 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:55.854765 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-b2ff3547-48f4-4271-9e49-be770737b860 req-97d21e1d-9250-40a3-8f02-971fc9e49221 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:55.867467 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.compute.server_external_events [req-b2ff3547-48f4-4271-9e49-be770737b860 req-97d21e1d-9250-40a3-8f02-971fc9e49221 service nova] Creating event network-vif-plugged:e830d7aa-cb37-4cb9-98b3-6e2ce9280079 for instance 4ffccc9e-10cc-413f-ac60-518d6541968a on hv-cinder-79987 Jul 15 20:40:55.875084 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [req-b2ff3547-48f4-4271-9e49-be770737b860 req-97d21e1d-9250-40a3-8f02-971fc9e49221 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040243 Jul 15 20:40:55.875719 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 293/584] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:40:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 20:40:56.165157 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-eb251848-2a47-490f-9fcf-430e8f282c18 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:56.165832 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-eb251848-2a47-490f-9fcf-430e8f282c18 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] [instance: b02f18ea-fd0b-4edd-97a7-17621ab67c8f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:56.174469 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-eb251848-2a47-490f-9fcf-430e8f282c18 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:56.174962 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-eb251848-2a47-490f-9fcf-430e8f282c18 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:56.175779 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-eb251848-2a47-490f-9fcf-430e8f282c18 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:56.176272 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-eb251848-2a47-490f-9fcf-430e8f282c18 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:56.317102 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-eb251848-2a47-490f-9fcf-430e8f282c18 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e27fccbf854a8b8c9d6d099893f783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e1593c67704dbbafad13310ca35448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:56.325616 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-eb251848-2a47-490f-9fcf-430e8f282c18 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] 10.222.0.66 "GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f" status: 200 len: 1442 microversion: 2.1 time: 0.164315 Jul 15 20:40:56.326447 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 292/585] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:56 2022] GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f => generated 1442 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:40:56.343407 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-10a4f8ce-8181-4dd9-8d71-ef67249d59d7 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:56.344104 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-10a4f8ce-8181-4dd9-8d71-ef67249d59d7 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] [instance: b02f18ea-fd0b-4edd-97a7-17621ab67c8f] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:56.350336 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-10a4f8ce-8181-4dd9-8d71-ef67249d59d7 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:56.350896 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-10a4f8ce-8181-4dd9-8d71-ef67249d59d7 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:56.351814 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-10a4f8ce-8181-4dd9-8d71-ef67249d59d7 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:56.352161 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-10a4f8ce-8181-4dd9-8d71-ef67249d59d7 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:56.494662 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-10a4f8ce-8181-4dd9-8d71-ef67249d59d7 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e27fccbf854a8b8c9d6d099893f783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e1593c67704dbbafad13310ca35448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:56.502262 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-10a4f8ce-8181-4dd9-8d71-ef67249d59d7 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] 10.222.0.66 "GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f" status: 200 len: 1442 microversion: 2.1 time: 0.164203 Jul 15 20:40:56.502833 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 294/586] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:56 2022] GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f => generated 1442 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:40:56.732853 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-a12f59c0-18bb-4cef-8aac-305deed04653 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:56.733498 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-a12f59c0-18bb-4cef-8aac-305deed04653 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 4ffccc9e-10cc-413f-ac60-518d6541968a] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:56.740580 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a12f59c0-18bb-4cef-8aac-305deed04653 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:56.741246 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a12f59c0-18bb-4cef-8aac-305deed04653 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:56.742193 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a12f59c0-18bb-4cef-8aac-305deed04653 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:56.742828 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a12f59c0-18bb-4cef-8aac-305deed04653 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:56.979965 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-a12f59c0-18bb-4cef-8aac-305deed04653 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:56.988916 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-a12f59c0-18bb-4cef-8aac-305deed04653 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/4ffccc9e-10cc-413f-ac60-518d6541968a" status: 200 len: 1366 microversion: 2.1 time: 0.260132 Jul 15 20:40:56.989654 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 293/587] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:56 2022] GET /compute/v2.1/servers/4ffccc9e-10cc-413f-ac60-518d6541968a => generated 1366 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:40:58.007126 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-b4c2c9ac-0e3c-456b-bdb7-f5ed8ef65067 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:58.007848 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-b4c2c9ac-0e3c-456b-bdb7-f5ed8ef65067 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 4ffccc9e-10cc-413f-ac60-518d6541968a] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:58.021419 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b4c2c9ac-0e3c-456b-bdb7-f5ed8ef65067 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:58.022042 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b4c2c9ac-0e3c-456b-bdb7-f5ed8ef65067 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:58.023329 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b4c2c9ac-0e3c-456b-bdb7-f5ed8ef65067 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:58.023967 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b4c2c9ac-0e3c-456b-bdb7-f5ed8ef65067 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:58.249412 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-b4c2c9ac-0e3c-456b-bdb7-f5ed8ef65067 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:40:58.257279 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-b4c2c9ac-0e3c-456b-bdb7-f5ed8ef65067 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/4ffccc9e-10cc-413f-ac60-518d6541968a" status: 200 len: 1557 microversion: 2.1 time: 0.254072 Jul 15 20:40:58.257966 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 295/588] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:40:58 2022] GET /compute/v2.1/servers/4ffccc9e-10cc-413f-ac60-518d6541968a => generated 1557 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:40:58.282278 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-12c033e5-b262-42b7-839b-592e2cceb204 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:40:58.282870 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-12c033e5-b262-42b7-839b-592e2cceb204 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 4ffccc9e-10cc-413f-ac60-518d6541968a] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:40:58.289611 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-12c033e5-b262-42b7-839b-592e2cceb204 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:58.290151 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-12c033e5-b262-42b7-839b-592e2cceb204 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:58.291470 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-12c033e5-b262-42b7-839b-592e2cceb204 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:58.292098 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-12c033e5-b262-42b7-839b-592e2cceb204 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:58.392993 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-12c033e5-b262-42b7-839b-592e2cceb204 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/4ffccc9e-10cc-413f-ac60-518d6541968a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.115127 Jul 15 20:40:58.399416 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 294/589] 10.222.0.66 () {58 vars in 1274 bytes} [Fri Jul 15 20:40:58 2022] GET /compute/v2.1/servers/4ffccc9e-10cc-413f-ac60-518d6541968a/os-interface => generated 285 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:40:58.607381 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [req-1e99ffed-8bb3-4b61-bf00-0f1401b60162 req-21531c09-662b-462c-852e-e0adbd781cfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b02f18ea-fd0b-4edd-97a7-17621ab67c8f", "tag": "dc16e8e1-450a-4c4e-9a65-56300299d066"}]} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:40:58.616400 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-1e99ffed-8bb3-4b61-bf00-0f1401b60162 req-21531c09-662b-462c-852e-e0adbd781cfa service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:40:58.616846 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-1e99ffed-8bb3-4b61-bf00-0f1401b60162 req-21531c09-662b-462c-852e-e0adbd781cfa service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:40:58.628948 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.compute.server_external_events [req-1e99ffed-8bb3-4b61-bf00-0f1401b60162 req-21531c09-662b-462c-852e-e0adbd781cfa service nova] Creating event network-changed:dc16e8e1-450a-4c4e-9a65-56300299d066 for instance b02f18ea-fd0b-4edd-97a7-17621ab67c8f on hv-cinder-79987 Jul 15 20:40:58.634128 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [req-1e99ffed-8bb3-4b61-bf00-0f1401b60162 req-21531c09-662b-462c-852e-e0adbd781cfa service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030457 Jul 15 20:40:58.635122 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 296/590] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:40:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 20:41:00.138403 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-56ed02e1-4e2b-45ec-9cf4-43ad0721f349 req-7eb12604-0f6b-461c-a0e0-06eb1bcdcf3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ffccc9e-10cc-413f-ac60-518d6541968a", "tag": "e830d7aa-cb37-4cb9-98b3-6e2ce9280079"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:41:00.146717 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-56ed02e1-4e2b-45ec-9cf4-43ad0721f349 req-7eb12604-0f6b-461c-a0e0-06eb1bcdcf3d service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:00.147156 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-56ed02e1-4e2b-45ec-9cf4-43ad0721f349 req-7eb12604-0f6b-461c-a0e0-06eb1bcdcf3d service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:00.159734 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-56ed02e1-4e2b-45ec-9cf4-43ad0721f349 req-7eb12604-0f6b-461c-a0e0-06eb1bcdcf3d service nova] Creating event network-changed:e830d7aa-cb37-4cb9-98b3-6e2ce9280079 for instance 4ffccc9e-10cc-413f-ac60-518d6541968a on hv-cinder-79987 Jul 15 20:41:00.164850 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-56ed02e1-4e2b-45ec-9cf4-43ad0721f349 req-7eb12604-0f6b-461c-a0e0-06eb1bcdcf3d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030727 Jul 15 20:41:00.165373 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 295/591] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:41:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:41:02.787914 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-ab4f2ef7-5989-4112-b53b-ab2687341820 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:41:02.788945 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-ab4f2ef7-5989-4112-b53b-ab2687341820 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 943a9a49-4fcd-46a5-b444-1a94f490ae2e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:41:02.795848 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-ab4f2ef7-5989-4112-b53b-ab2687341820 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:02.796290 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-ab4f2ef7-5989-4112-b53b-ab2687341820 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:02.797072 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-ab4f2ef7-5989-4112-b53b-ab2687341820 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:02.797504 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-ab4f2ef7-5989-4112-b53b-ab2687341820 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:02.819809 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.objects.instance [None req-ab4f2ef7-5989-4112-b53b-ab2687341820 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lazy-loading 'flavor' on Instance uuid 943a9a49-4fcd-46a5-b444-1a94f490ae2e {{(pid=124430) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 20:41:02.938995 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-ab4f2ef7-5989-4112-b53b-ab2687341820 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "POST /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e/action" status: 200 len: 32 microversion: 2.1 time: 0.155815 Jul 15 20:41:02.939642 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 297/592] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 15 20:41:02 2022] POST /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e/action => generated 32 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 15 20:41:02.949715 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-942c5cfc-d01f-455f-aa6c-860c06b50b31 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:41:02.951167 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-942c5cfc-d01f-455f-aa6c-860c06b50b31 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 943a9a49-4fcd-46a5-b444-1a94f490ae2e] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:41:02.957671 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-942c5cfc-d01f-455f-aa6c-860c06b50b31 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:02.958120 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-942c5cfc-d01f-455f-aa6c-860c06b50b31 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:02.958889 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-942c5cfc-d01f-455f-aa6c-860c06b50b31 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:02.959323 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-942c5cfc-d01f-455f-aa6c-860c06b50b31 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:03.092554 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-942c5cfc-d01f-455f-aa6c-860c06b50b31 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:41:03.100927 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-942c5cfc-d01f-455f-aa6c-860c06b50b31 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e" status: 200 len: 1737 microversion: 2.1 time: 0.155829 Jul 15 20:41:03.101689 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 296/593] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:41:02 2022] GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:41:04.119766 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-58fdf3b5-367d-400c-98fa-09c1068957f4 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:41:04.120483 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-58fdf3b5-367d-400c-98fa-09c1068957f4 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 943a9a49-4fcd-46a5-b444-1a94f490ae2e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:41:04.127584 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-58fdf3b5-367d-400c-98fa-09c1068957f4 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:04.128034 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-58fdf3b5-367d-400c-98fa-09c1068957f4 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:04.128822 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-58fdf3b5-367d-400c-98fa-09c1068957f4 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:04.129260 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-58fdf3b5-367d-400c-98fa-09c1068957f4 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:04.300294 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-58fdf3b5-367d-400c-98fa-09c1068957f4 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:41:04.308211 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-58fdf3b5-367d-400c-98fa-09c1068957f4 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e" status: 200 len: 1737 microversion: 2.1 time: 0.193160 Jul 15 20:41:04.308979 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 298/594] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:41:04 2022] GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e => generated 1737 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:41:05.326937 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-b09a058d-315a-4f66-a628-29d8fff12bd2 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:41:05.327656 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-b09a058d-315a-4f66-a628-29d8fff12bd2 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 943a9a49-4fcd-46a5-b444-1a94f490ae2e] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:41:05.330292 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:41:05.335571 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b09a058d-315a-4f66-a628-29d8fff12bd2 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:05.336025 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b09a058d-315a-4f66-a628-29d8fff12bd2 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:05.336851 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b09a058d-315a-4f66-a628-29d8fff12bd2 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:05.337456 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b09a058d-315a-4f66-a628-29d8fff12bd2 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:05.483671 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-b09a058d-315a-4f66-a628-29d8fff12bd2 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:41:05.491601 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-b09a058d-315a-4f66-a628-29d8fff12bd2 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e" status: 200 len: 1737 microversion: 2.1 time: 0.168509 Jul 15 20:41:05.492167 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 297/595] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:41:05 2022] GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e => generated 1737 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:41:06.508663 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-c7a2cfa4-acb0-46b8-9a06-ca3358c02e0e tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:41:06.509294 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-c7a2cfa4-acb0-46b8-9a06-ca3358c02e0e tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 943a9a49-4fcd-46a5-b444-1a94f490ae2e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:41:06.516403 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c7a2cfa4-acb0-46b8-9a06-ca3358c02e0e tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:06.516866 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c7a2cfa4-acb0-46b8-9a06-ca3358c02e0e tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:06.517720 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c7a2cfa4-acb0-46b8-9a06-ca3358c02e0e tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:06.518182 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c7a2cfa4-acb0-46b8-9a06-ca3358c02e0e tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:06.650895 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-c7a2cfa4-acb0-46b8-9a06-ca3358c02e0e tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:41:06.659399 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-c7a2cfa4-acb0-46b8-9a06-ca3358c02e0e tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e" status: 200 len: 1737 microversion: 2.1 time: 0.154887 Jul 15 20:41:06.659959 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 299/596] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:41:06 2022] GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:41:07.676769 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-c7018df8-35e2-4a20-99cf-739e96d39f1e tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:41:07.677375 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-c7018df8-35e2-4a20-99cf-739e96d39f1e tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 943a9a49-4fcd-46a5-b444-1a94f490ae2e] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:41:07.683582 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c7018df8-35e2-4a20-99cf-739e96d39f1e tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:07.684030 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c7018df8-35e2-4a20-99cf-739e96d39f1e tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:07.685213 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c7018df8-35e2-4a20-99cf-739e96d39f1e tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:07.685659 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c7018df8-35e2-4a20-99cf-739e96d39f1e tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:07.810356 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-8f5ae602-b3ef-4423-9e5d-f38675e189a7 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:41:07.811357 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-8f5ae602-b3ef-4423-9e5d-f38675e189a7 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] [instance: 67ed2b36-9422-4f98-8a39-83c214eadae9] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:41:07.817847 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8f5ae602-b3ef-4423-9e5d-f38675e189a7 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:07.818296 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8f5ae602-b3ef-4423-9e5d-f38675e189a7 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:07.819056 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8f5ae602-b3ef-4423-9e5d-f38675e189a7 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:07.819487 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8f5ae602-b3ef-4423-9e5d-f38675e189a7 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:07.820213 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-c7018df8-35e2-4a20-99cf-739e96d39f1e tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:41:07.829255 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-c7018df8-35e2-4a20-99cf-739e96d39f1e tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e" status: 200 len: 1737 microversion: 2.1 time: 0.156270 Jul 15 20:41:07.830081 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 298/597] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:41:07 2022] GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:41:07.891168 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-8f5ae602-b3ef-4423-9e5d-f38675e189a7 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] 10.222.0.66 "POST /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9/action" status: 202 len: 0 microversion: 2.1 time: 0.084506 Jul 15 20:41:07.892357 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 300/598] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 15 20:41:07 2022] POST /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 15 20:41:07.900579 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-1e4a7e45-4ebd-4c70-b485-b714d5bcb213 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:41:07.901033 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-1e4a7e45-4ebd-4c70-b485-b714d5bcb213 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] [instance: 67ed2b36-9422-4f98-8a39-83c214eadae9] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:41:07.907968 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1e4a7e45-4ebd-4c70-b485-b714d5bcb213 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:07.908452 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1e4a7e45-4ebd-4c70-b485-b714d5bcb213 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:07.909337 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1e4a7e45-4ebd-4c70-b485-b714d5bcb213 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:07.909750 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1e4a7e45-4ebd-4c70-b485-b714d5bcb213 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:08.052427 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-1e4a7e45-4ebd-4c70-b485-b714d5bcb213 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a573525d244ab3ab69095db8871f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d62130d6f74b8e919e429cbb3afc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:41:08.061060 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-1e4a7e45-4ebd-4c70-b485-b714d5bcb213 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] 10.222.0.66 "GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9" status: 200 len: 1750 microversion: 2.1 time: 0.164637 Jul 15 20:41:08.061624 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 299/599] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:41:07 2022] GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9 => generated 1750 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:41:08.847884 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-dfbd5655-3be4-437c-b04a-4a8045966668 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:41:08.848557 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-dfbd5655-3be4-437c-b04a-4a8045966668 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 943a9a49-4fcd-46a5-b444-1a94f490ae2e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:41:08.854736 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-dfbd5655-3be4-437c-b04a-4a8045966668 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:08.855173 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-dfbd5655-3be4-437c-b04a-4a8045966668 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:08.855925 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-dfbd5655-3be4-437c-b04a-4a8045966668 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:08.857032 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-dfbd5655-3be4-437c-b04a-4a8045966668 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:08.992381 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-dfbd5655-3be4-437c-b04a-4a8045966668 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:41:09.000917 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-dfbd5655-3be4-437c-b04a-4a8045966668 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e" status: 200 len: 1737 microversion: 2.1 time: 0.157784 Jul 15 20:41:09.001474 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 301/600] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:41:08 2022] GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:41:09.078227 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-85d0c37a-e90d-4f06-945b-38393d685f2d tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:41:09.078831 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-85d0c37a-e90d-4f06-945b-38393d685f2d tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] [instance: 67ed2b36-9422-4f98-8a39-83c214eadae9] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:41:09.085569 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-85d0c37a-e90d-4f06-945b-38393d685f2d tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:09.086015 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-85d0c37a-e90d-4f06-945b-38393d685f2d tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:09.086771 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-85d0c37a-e90d-4f06-945b-38393d685f2d tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:09.087202 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-85d0c37a-e90d-4f06-945b-38393d685f2d tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:09.228478 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-85d0c37a-e90d-4f06-945b-38393d685f2d tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a573525d244ab3ab69095db8871f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d62130d6f74b8e919e429cbb3afc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:41:09.237407 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-85d0c37a-e90d-4f06-945b-38393d685f2d tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] 10.222.0.66 "GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9" status: 200 len: 1750 microversion: 2.1 time: 0.163301 Jul 15 20:41:09.237981 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 300/601] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:41:09 2022] GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9 => generated 1750 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:41:10.018376 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-c6f3d0d1-ac9b-4e4b-b74e-5e4312b7e087 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:41:10.018976 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-c6f3d0d1-ac9b-4e4b-b74e-5e4312b7e087 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 943a9a49-4fcd-46a5-b444-1a94f490ae2e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:41:10.025434 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c6f3d0d1-ac9b-4e4b-b74e-5e4312b7e087 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:10.025877 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c6f3d0d1-ac9b-4e4b-b74e-5e4312b7e087 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:10.026631 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c6f3d0d1-ac9b-4e4b-b74e-5e4312b7e087 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:10.027064 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c6f3d0d1-ac9b-4e4b-b74e-5e4312b7e087 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:10.164978 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-c6f3d0d1-ac9b-4e4b-b74e-5e4312b7e087 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:41:10.173848 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-c6f3d0d1-ac9b-4e4b-b74e-5e4312b7e087 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e" status: 200 len: 1737 microversion: 2.1 time: 0.159312 Jul 15 20:41:10.174415 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 302/602] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:41:10 2022] GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:41:10.256401 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-c24e26df-2f37-4f59-85f8-154919c48a80 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:41:10.257096 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-c24e26df-2f37-4f59-85f8-154919c48a80 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] [instance: 67ed2b36-9422-4f98-8a39-83c214eadae9] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:41:10.263836 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c24e26df-2f37-4f59-85f8-154919c48a80 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:10.264282 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c24e26df-2f37-4f59-85f8-154919c48a80 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:10.265069 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c24e26df-2f37-4f59-85f8-154919c48a80 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:10.265513 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c24e26df-2f37-4f59-85f8-154919c48a80 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:10.408670 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-c24e26df-2f37-4f59-85f8-154919c48a80 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a573525d244ab3ab69095db8871f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d62130d6f74b8e919e429cbb3afc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:41:10.417047 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-c24e26df-2f37-4f59-85f8-154919c48a80 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] 10.222.0.66 "GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9" status: 200 len: 1750 microversion: 2.1 time: 0.164459 Jul 15 20:41:10.418237 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 301/603] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:41:10 2022] GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9 => generated 1750 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:41:11.190896 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-31438d17-de8a-443e-b366-0f18a16861e0 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:41:11.191504 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-31438d17-de8a-443e-b366-0f18a16861e0 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 943a9a49-4fcd-46a5-b444-1a94f490ae2e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:41:11.198011 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-31438d17-de8a-443e-b366-0f18a16861e0 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:11.198456 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-31438d17-de8a-443e-b366-0f18a16861e0 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:11.199212 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-31438d17-de8a-443e-b366-0f18a16861e0 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:11.199643 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-31438d17-de8a-443e-b366-0f18a16861e0 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:11.330392 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-31438d17-de8a-443e-b366-0f18a16861e0 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:41:11.338625 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-31438d17-de8a-443e-b366-0f18a16861e0 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e" status: 200 len: 1737 microversion: 2.1 time: 0.151586 Jul 15 20:41:11.339186 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 303/604] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:41:11 2022] GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:41:11.436373 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-18690c00-2a64-4109-8024-862727c87376 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:41:11.437046 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-18690c00-2a64-4109-8024-862727c87376 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] [instance: 67ed2b36-9422-4f98-8a39-83c214eadae9] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:41:11.443600 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-18690c00-2a64-4109-8024-862727c87376 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:11.443994 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-18690c00-2a64-4109-8024-862727c87376 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:11.444789 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-18690c00-2a64-4109-8024-862727c87376 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:11.445230 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-18690c00-2a64-4109-8024-862727c87376 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:11.591823 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-18690c00-2a64-4109-8024-862727c87376 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a573525d244ab3ab69095db8871f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d62130d6f74b8e919e429cbb3afc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:41:11.600620 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-18690c00-2a64-4109-8024-862727c87376 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] 10.222.0.66 "GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9" status: 200 len: 1755 microversion: 2.1 time: 0.168988 Jul 15 20:41:11.601199 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 302/605] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:41:11 2022] GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:41:12.355662 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-eae2845d-8802-4c99-84fd-1a989fe58996 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:41:12.357196 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-eae2845d-8802-4c99-84fd-1a989fe58996 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 943a9a49-4fcd-46a5-b444-1a94f490ae2e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:41:12.359340 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:41:12.367182 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-eae2845d-8802-4c99-84fd-1a989fe58996 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:12.367803 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-eae2845d-8802-4c99-84fd-1a989fe58996 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:12.369236 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-eae2845d-8802-4c99-84fd-1a989fe58996 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:12.370033 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-eae2845d-8802-4c99-84fd-1a989fe58996 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:12.377341 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:41:12.506013 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-eae2845d-8802-4c99-84fd-1a989fe58996 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:41:12.513937 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-eae2845d-8802-4c99-84fd-1a989fe58996 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e" status: 200 len: 1737 microversion: 2.1 time: 0.162171 Jul 15 20:41:12.514496 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 304/606] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:41:12 2022] GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:41:12.617881 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-37c5bfa9-718c-4e9c-be29-674332e5915e tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:41:12.618477 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-37c5bfa9-718c-4e9c-be29-674332e5915e tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] [instance: 67ed2b36-9422-4f98-8a39-83c214eadae9] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:41:12.625894 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-37c5bfa9-718c-4e9c-be29-674332e5915e tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:12.626318 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-37c5bfa9-718c-4e9c-be29-674332e5915e tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:12.627074 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-37c5bfa9-718c-4e9c-be29-674332e5915e tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:12.627498 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-37c5bfa9-718c-4e9c-be29-674332e5915e tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:12.778284 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-37c5bfa9-718c-4e9c-be29-674332e5915e tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a573525d244ab3ab69095db8871f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d62130d6f74b8e919e429cbb3afc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:41:12.786576 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-37c5bfa9-718c-4e9c-be29-674332e5915e tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] 10.222.0.66 "GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9" status: 200 len: 1755 microversion: 2.1 time: 0.172456 Jul 15 20:41:12.787127 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 303/607] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:41:12 2022] GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9 => generated 1755 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:41:13.531397 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-225df2ae-8b35-4a43-80da-db9c8f7feb46 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:41:13.531991 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-225df2ae-8b35-4a43-80da-db9c8f7feb46 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 943a9a49-4fcd-46a5-b444-1a94f490ae2e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:41:13.538749 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-225df2ae-8b35-4a43-80da-db9c8f7feb46 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:13.539202 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-225df2ae-8b35-4a43-80da-db9c8f7feb46 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:13.539971 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-225df2ae-8b35-4a43-80da-db9c8f7feb46 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:13.540440 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-225df2ae-8b35-4a43-80da-db9c8f7feb46 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:13.672750 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-225df2ae-8b35-4a43-80da-db9c8f7feb46 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:41:13.680590 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-225df2ae-8b35-4a43-80da-db9c8f7feb46 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e" status: 200 len: 1737 microversion: 2.1 time: 0.153581 Jul 15 20:41:13.681143 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 305/608] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:41:13 2022] GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:41:13.803939 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-eb03c374-74c0-4885-8bb2-96742f779e6b tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:41:13.804580 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-eb03c374-74c0-4885-8bb2-96742f779e6b tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] [instance: 67ed2b36-9422-4f98-8a39-83c214eadae9] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:41:13.811732 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-eb03c374-74c0-4885-8bb2-96742f779e6b tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:13.812172 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-eb03c374-74c0-4885-8bb2-96742f779e6b tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:13.812951 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-eb03c374-74c0-4885-8bb2-96742f779e6b tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:13.813381 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-eb03c374-74c0-4885-8bb2-96742f779e6b tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:13.961864 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-eb03c374-74c0-4885-8bb2-96742f779e6b tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a573525d244ab3ab69095db8871f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d62130d6f74b8e919e429cbb3afc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:41:13.970357 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-eb03c374-74c0-4885-8bb2-96742f779e6b tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] 10.222.0.66 "GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9" status: 200 len: 1755 microversion: 2.1 time: 0.170161 Jul 15 20:41:13.970931 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 304/609] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:41:13 2022] GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:41:14.698063 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-04ddc5af-861e-446b-951b-f404e066d04c tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:41:14.698666 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-04ddc5af-861e-446b-951b-f404e066d04c tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 943a9a49-4fcd-46a5-b444-1a94f490ae2e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:41:14.705180 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-04ddc5af-861e-446b-951b-f404e066d04c tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:14.705637 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-04ddc5af-861e-446b-951b-f404e066d04c tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:14.706382 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-04ddc5af-861e-446b-951b-f404e066d04c tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:14.706808 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-04ddc5af-861e-446b-951b-f404e066d04c tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:14.849392 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-04ddc5af-861e-446b-951b-f404e066d04c tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:41:14.857933 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-04ddc5af-861e-446b-951b-f404e066d04c tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e" status: 200 len: 1737 microversion: 2.1 time: 0.163804 Jul 15 20:41:14.858492 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 306/610] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:41:14 2022] GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:41:14.987934 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-d3045cab-3c0e-4fa9-9c26-2f94383c30e3 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:41:14.988490 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-d3045cab-3c0e-4fa9-9c26-2f94383c30e3 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] [instance: 67ed2b36-9422-4f98-8a39-83c214eadae9] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:41:14.994874 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d3045cab-3c0e-4fa9-9c26-2f94383c30e3 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:14.995320 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d3045cab-3c0e-4fa9-9c26-2f94383c30e3 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:14.996105 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d3045cab-3c0e-4fa9-9c26-2f94383c30e3 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:14.996565 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d3045cab-3c0e-4fa9-9c26-2f94383c30e3 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:15.138830 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-d3045cab-3c0e-4fa9-9c26-2f94383c30e3 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a573525d244ab3ab69095db8871f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d62130d6f74b8e919e429cbb3afc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:41:15.146881 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-d3045cab-3c0e-4fa9-9c26-2f94383c30e3 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] 10.222.0.66 "GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9" status: 200 len: 1755 microversion: 2.1 time: 0.162915 Jul 15 20:41:15.147450 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 305/611] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:41:14 2022] GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:41:15.875726 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-0d45db01-ab57-4a50-a8ca-14edea1ea4ad tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:41:15.876337 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-0d45db01-ab57-4a50-a8ca-14edea1ea4ad tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 943a9a49-4fcd-46a5-b444-1a94f490ae2e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:41:15.882734 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-0d45db01-ab57-4a50-a8ca-14edea1ea4ad tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:15.883221 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-0d45db01-ab57-4a50-a8ca-14edea1ea4ad tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:15.883980 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-0d45db01-ab57-4a50-a8ca-14edea1ea4ad tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:15.884434 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-0d45db01-ab57-4a50-a8ca-14edea1ea4ad tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:16.033112 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-0d45db01-ab57-4a50-a8ca-14edea1ea4ad tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:41:16.042594 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-0d45db01-ab57-4a50-a8ca-14edea1ea4ad tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e" status: 200 len: 1737 microversion: 2.1 time: 0.171330 Jul 15 20:41:16.043171 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 307/612] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:41:15 2022] GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e => generated 1737 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:41:16.165731 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-407a124f-fcd7-4987-a58a-5ac4eeedfaf5 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:41:16.166611 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-407a124f-fcd7-4987-a58a-5ac4eeedfaf5 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] [instance: 67ed2b36-9422-4f98-8a39-83c214eadae9] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:41:16.173280 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-407a124f-fcd7-4987-a58a-5ac4eeedfaf5 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:16.173722 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-407a124f-fcd7-4987-a58a-5ac4eeedfaf5 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:16.174495 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-407a124f-fcd7-4987-a58a-5ac4eeedfaf5 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:16.174921 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-407a124f-fcd7-4987-a58a-5ac4eeedfaf5 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:16.322358 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-407a124f-fcd7-4987-a58a-5ac4eeedfaf5 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a573525d244ab3ab69095db8871f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d62130d6f74b8e919e429cbb3afc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:41:16.326022 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell1:SELECT=100 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:41:16.331928 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-407a124f-fcd7-4987-a58a-5ac4eeedfaf5 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] 10.222.0.66 "GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9" status: 200 len: 1755 microversion: 2.1 time: 0.170282 Jul 15 20:41:16.332502 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 306/613] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:41:16 2022] GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:41:17.058689 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-9255a989-ca27-4280-9ab1-3cf1cec9636f tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:41:17.060078 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-9255a989-ca27-4280-9ab1-3cf1cec9636f tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 943a9a49-4fcd-46a5-b444-1a94f490ae2e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:41:17.066517 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-9255a989-ca27-4280-9ab1-3cf1cec9636f tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:17.066968 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-9255a989-ca27-4280-9ab1-3cf1cec9636f tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:17.067732 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-9255a989-ca27-4280-9ab1-3cf1cec9636f tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:17.068175 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-9255a989-ca27-4280-9ab1-3cf1cec9636f tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:17.196633 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-9255a989-ca27-4280-9ab1-3cf1cec9636f tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:41:17.204943 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-9255a989-ca27-4280-9ab1-3cf1cec9636f tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e" status: 200 len: 1737 microversion: 2.1 time: 0.149989 Jul 15 20:41:17.205502 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 308/614] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:41:17 2022] GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:41:17.348718 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-d8b174bc-a6c8-475a-a36e-3031d5352c98 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:41:17.349232 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-d8b174bc-a6c8-475a-a36e-3031d5352c98 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] [instance: 67ed2b36-9422-4f98-8a39-83c214eadae9] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:41:17.355828 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d8b174bc-a6c8-475a-a36e-3031d5352c98 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:17.357098 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d8b174bc-a6c8-475a-a36e-3031d5352c98 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:17.357923 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d8b174bc-a6c8-475a-a36e-3031d5352c98 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:17.358356 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d8b174bc-a6c8-475a-a36e-3031d5352c98 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:17.503776 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-d8b174bc-a6c8-475a-a36e-3031d5352c98 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a573525d244ab3ab69095db8871f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d62130d6f74b8e919e429cbb3afc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:41:17.511590 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-d8b174bc-a6c8-475a-a36e-3031d5352c98 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] 10.222.0.66 "GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9" status: 200 len: 1755 microversion: 2.1 time: 0.166830 Jul 15 20:41:17.512740 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 307/615] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:41:17 2022] GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:41:18.222250 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-62609809-a74a-4b75-97ca-25dbd778d9db tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:41:18.222861 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-62609809-a74a-4b75-97ca-25dbd778d9db tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 943a9a49-4fcd-46a5-b444-1a94f490ae2e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:41:18.229686 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-62609809-a74a-4b75-97ca-25dbd778d9db tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:18.230190 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-62609809-a74a-4b75-97ca-25dbd778d9db tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:18.230879 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-62609809-a74a-4b75-97ca-25dbd778d9db tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:18.231838 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-62609809-a74a-4b75-97ca-25dbd778d9db tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:18.361830 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-62609809-a74a-4b75-97ca-25dbd778d9db tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:41:18.369921 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-62609809-a74a-4b75-97ca-25dbd778d9db tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e" status: 200 len: 1737 microversion: 2.1 time: 0.151534 Jul 15 20:41:18.370479 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 309/616] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:41:18 2022] GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:41:18.528634 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-3efd9673-b7bc-482c-8a02-14b411c5382a tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:41:18.529267 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-3efd9673-b7bc-482c-8a02-14b411c5382a tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] [instance: 67ed2b36-9422-4f98-8a39-83c214eadae9] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:41:18.535872 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3efd9673-b7bc-482c-8a02-14b411c5382a tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:18.536315 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3efd9673-b7bc-482c-8a02-14b411c5382a tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:18.537108 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3efd9673-b7bc-482c-8a02-14b411c5382a tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:18.537541 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3efd9673-b7bc-482c-8a02-14b411c5382a tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:18.678077 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-3efd9673-b7bc-482c-8a02-14b411c5382a tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a573525d244ab3ab69095db8871f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d62130d6f74b8e919e429cbb3afc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:41:18.686940 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-3efd9673-b7bc-482c-8a02-14b411c5382a tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] 10.222.0.66 "GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9" status: 200 len: 1755 microversion: 2.1 time: 0.162236 Jul 15 20:41:18.687510 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 308/617] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:41:18 2022] GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9 => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:41:19.386441 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-e9593a55-94fc-4773-aa9c-f958ed96d104 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:41:19.386950 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-e9593a55-94fc-4773-aa9c-f958ed96d104 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 943a9a49-4fcd-46a5-b444-1a94f490ae2e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:41:19.393651 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e9593a55-94fc-4773-aa9c-f958ed96d104 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:19.394109 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e9593a55-94fc-4773-aa9c-f958ed96d104 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:19.394861 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e9593a55-94fc-4773-aa9c-f958ed96d104 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:19.395294 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e9593a55-94fc-4773-aa9c-f958ed96d104 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:19.521622 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-e9593a55-94fc-4773-aa9c-f958ed96d104 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:41:19.530466 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-e9593a55-94fc-4773-aa9c-f958ed96d104 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e" status: 200 len: 1737 microversion: 2.1 time: 0.147927 Jul 15 20:41:19.531031 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 310/618] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:41:19 2022] GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:41:19.704184 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-e9739196-d813-4780-bf7f-318d3141948a tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:41:19.704802 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-e9739196-d813-4780-bf7f-318d3141948a tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] [instance: 67ed2b36-9422-4f98-8a39-83c214eadae9] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:41:19.711302 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e9739196-d813-4780-bf7f-318d3141948a tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:19.711744 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e9739196-d813-4780-bf7f-318d3141948a tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:19.712526 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e9739196-d813-4780-bf7f-318d3141948a tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:19.712961 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e9739196-d813-4780-bf7f-318d3141948a tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:19.863860 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-e9739196-d813-4780-bf7f-318d3141948a tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a573525d244ab3ab69095db8871f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d62130d6f74b8e919e429cbb3afc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:41:19.872120 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-e9739196-d813-4780-bf7f-318d3141948a tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] 10.222.0.66 "GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9" status: 200 len: 1755 microversion: 2.1 time: 0.172230 Jul 15 20:41:19.872714 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 309/619] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:41:19 2022] GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9 => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:41:20.547799 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-f641a135-f3cc-4adf-951c-ea810fcc76f0 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:41:20.548429 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-f641a135-f3cc-4adf-951c-ea810fcc76f0 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 943a9a49-4fcd-46a5-b444-1a94f490ae2e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:41:20.554973 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-f641a135-f3cc-4adf-951c-ea810fcc76f0 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:20.555419 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-f641a135-f3cc-4adf-951c-ea810fcc76f0 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:20.556170 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-f641a135-f3cc-4adf-951c-ea810fcc76f0 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:20.556649 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-f641a135-f3cc-4adf-951c-ea810fcc76f0 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:20.691568 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-f641a135-f3cc-4adf-951c-ea810fcc76f0 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:41:20.700595 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-f641a135-f3cc-4adf-951c-ea810fcc76f0 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e" status: 200 len: 1737 microversion: 2.1 time: 0.156536 Jul 15 20:41:20.701161 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 311/620] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:41:20 2022] GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:41:20.889145 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-2183d804-bbe1-489c-8d4d-9605477304a1 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:41:20.889679 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-2183d804-bbe1-489c-8d4d-9605477304a1 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] [instance: 67ed2b36-9422-4f98-8a39-83c214eadae9] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:41:20.895982 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2183d804-bbe1-489c-8d4d-9605477304a1 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:20.896443 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2183d804-bbe1-489c-8d4d-9605477304a1 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:20.897247 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2183d804-bbe1-489c-8d4d-9605477304a1 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:20.897650 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2183d804-bbe1-489c-8d4d-9605477304a1 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:21.050594 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-2183d804-bbe1-489c-8d4d-9605477304a1 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a573525d244ab3ab69095db8871f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d62130d6f74b8e919e429cbb3afc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:41:21.058997 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-2183d804-bbe1-489c-8d4d-9605477304a1 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] 10.222.0.66 "GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9" status: 200 len: 1755 microversion: 2.1 time: 0.173915 Jul 15 20:41:21.059577 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 310/621] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:41:20 2022] GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9 => generated 1755 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:41:21.717645 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-dd76576a-ae70-446c-b750-35efe2ba15c4 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:41:21.718160 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-dd76576a-ae70-446c-b750-35efe2ba15c4 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 943a9a49-4fcd-46a5-b444-1a94f490ae2e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:41:21.724706 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-dd76576a-ae70-446c-b750-35efe2ba15c4 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:21.725159 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-dd76576a-ae70-446c-b750-35efe2ba15c4 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:21.725921 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-dd76576a-ae70-446c-b750-35efe2ba15c4 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:21.726360 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-dd76576a-ae70-446c-b750-35efe2ba15c4 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:21.857267 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-dd76576a-ae70-446c-b750-35efe2ba15c4 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:41:21.865452 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-dd76576a-ae70-446c-b750-35efe2ba15c4 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e" status: 200 len: 1737 microversion: 2.1 time: 0.152153 Jul 15 20:41:21.866014 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 312/622] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:41:21 2022] GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:41:22.076609 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-c9c6bc6d-bac9-4328-ac74-379e37fac0f5 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:41:22.077133 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-c9c6bc6d-bac9-4328-ac74-379e37fac0f5 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] [instance: 67ed2b36-9422-4f98-8a39-83c214eadae9] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:41:22.083725 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c9c6bc6d-bac9-4328-ac74-379e37fac0f5 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:22.084195 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c9c6bc6d-bac9-4328-ac74-379e37fac0f5 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:22.084994 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c9c6bc6d-bac9-4328-ac74-379e37fac0f5 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:22.085423 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c9c6bc6d-bac9-4328-ac74-379e37fac0f5 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:22.234834 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-c9c6bc6d-bac9-4328-ac74-379e37fac0f5 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a573525d244ab3ab69095db8871f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d62130d6f74b8e919e429cbb3afc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:41:22.242806 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-c9c6bc6d-bac9-4328-ac74-379e37fac0f5 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] 10.222.0.66 "GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9" status: 200 len: 1755 microversion: 2.1 time: 0.170476 Jul 15 20:41:22.243374 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 311/623] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:41:22 2022] GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9 => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:41:22.883620 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-b282d69d-b226-4402-8d84-8d82d66a8c73 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:41:22.884153 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-b282d69d-b226-4402-8d84-8d82d66a8c73 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 943a9a49-4fcd-46a5-b444-1a94f490ae2e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:41:22.891151 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b282d69d-b226-4402-8d84-8d82d66a8c73 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:22.891582 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b282d69d-b226-4402-8d84-8d82d66a8c73 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:22.892328 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b282d69d-b226-4402-8d84-8d82d66a8c73 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:22.892800 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b282d69d-b226-4402-8d84-8d82d66a8c73 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:23.025315 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-b282d69d-b226-4402-8d84-8d82d66a8c73 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:41:23.034138 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-b282d69d-b226-4402-8d84-8d82d66a8c73 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e" status: 200 len: 1737 microversion: 2.1 time: 0.154399 Jul 15 20:41:23.034663 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 313/624] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:41:22 2022] GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:41:23.261072 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-6b94d319-9341-4b69-8b99-ffae4a7286a2 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:41:23.261661 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-6b94d319-9341-4b69-8b99-ffae4a7286a2 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] [instance: 67ed2b36-9422-4f98-8a39-83c214eadae9] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:41:23.269600 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6b94d319-9341-4b69-8b99-ffae4a7286a2 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:23.270084 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6b94d319-9341-4b69-8b99-ffae4a7286a2 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:23.270850 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6b94d319-9341-4b69-8b99-ffae4a7286a2 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:23.271288 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6b94d319-9341-4b69-8b99-ffae4a7286a2 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:23.409970 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-6b94d319-9341-4b69-8b99-ffae4a7286a2 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a573525d244ab3ab69095db8871f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d62130d6f74b8e919e429cbb3afc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:41:23.418061 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-6b94d319-9341-4b69-8b99-ffae4a7286a2 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] 10.222.0.66 "GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9" status: 200 len: 1755 microversion: 2.1 time: 0.160806 Jul 15 20:41:23.418644 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 312/625] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:41:23 2022] GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9 => generated 1755 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:41:24.050987 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-3a698f9d-2c27-4f28-9e17-b1d3f73d6d67 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:41:24.051600 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-3a698f9d-2c27-4f28-9e17-b1d3f73d6d67 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 943a9a49-4fcd-46a5-b444-1a94f490ae2e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:41:24.058225 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-3a698f9d-2c27-4f28-9e17-b1d3f73d6d67 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:24.058676 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-3a698f9d-2c27-4f28-9e17-b1d3f73d6d67 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:24.059442 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-3a698f9d-2c27-4f28-9e17-b1d3f73d6d67 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:24.059878 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-3a698f9d-2c27-4f28-9e17-b1d3f73d6d67 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:24.201126 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-3a698f9d-2c27-4f28-9e17-b1d3f73d6d67 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:41:24.208962 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-3a698f9d-2c27-4f28-9e17-b1d3f73d6d67 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e" status: 200 len: 1737 microversion: 2.1 time: 0.161856 Jul 15 20:41:24.209522 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 314/626] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:41:24 2022] GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:41:24.434968 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-5e4d16de-90c8-4ae5-b4ed-2f7a6585dcfe tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:41:24.436466 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-5e4d16de-90c8-4ae5-b4ed-2f7a6585dcfe tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] [instance: 67ed2b36-9422-4f98-8a39-83c214eadae9] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:41:24.443136 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5e4d16de-90c8-4ae5-b4ed-2f7a6585dcfe tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:24.443591 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5e4d16de-90c8-4ae5-b4ed-2f7a6585dcfe tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:24.444361 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5e4d16de-90c8-4ae5-b4ed-2f7a6585dcfe tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:24.444816 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5e4d16de-90c8-4ae5-b4ed-2f7a6585dcfe tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:24.586577 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-5e4d16de-90c8-4ae5-b4ed-2f7a6585dcfe tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a573525d244ab3ab69095db8871f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d62130d6f74b8e919e429cbb3afc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:41:24.595123 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-5e4d16de-90c8-4ae5-b4ed-2f7a6585dcfe tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] 10.222.0.66 "GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9" status: 200 len: 1755 microversion: 2.1 time: 0.164022 Jul 15 20:41:24.595688 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 313/627] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:41:24 2022] GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:41:25.226365 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-707251a4-4314-4bf3-bfbb-01f910601463 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:41:25.226997 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-707251a4-4314-4bf3-bfbb-01f910601463 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 943a9a49-4fcd-46a5-b444-1a94f490ae2e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:41:25.234391 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-707251a4-4314-4bf3-bfbb-01f910601463 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:25.234847 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-707251a4-4314-4bf3-bfbb-01f910601463 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:25.235616 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-707251a4-4314-4bf3-bfbb-01f910601463 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:25.236052 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-707251a4-4314-4bf3-bfbb-01f910601463 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:25.397985 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-707251a4-4314-4bf3-bfbb-01f910601463 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:41:25.407162 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-707251a4-4314-4bf3-bfbb-01f910601463 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e" status: 200 len: 1737 microversion: 2.1 time: 0.185320 Jul 15 20:41:25.407766 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 315/628] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:41:25 2022] GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e => generated 1737 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:41:25.612848 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-9e862fb4-555b-4c18-8bb3-2e8155b90dce tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:41:25.613763 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-9e862fb4-555b-4c18-8bb3-2e8155b90dce tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] [instance: 67ed2b36-9422-4f98-8a39-83c214eadae9] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:41:25.620656 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9e862fb4-555b-4c18-8bb3-2e8155b90dce tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:25.621104 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9e862fb4-555b-4c18-8bb3-2e8155b90dce tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:25.621869 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9e862fb4-555b-4c18-8bb3-2e8155b90dce tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:25.622301 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9e862fb4-555b-4c18-8bb3-2e8155b90dce tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:25.815479 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-9e862fb4-555b-4c18-8bb3-2e8155b90dce tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a573525d244ab3ab69095db8871f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d62130d6f74b8e919e429cbb3afc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:41:25.823654 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-9e862fb4-555b-4c18-8bb3-2e8155b90dce tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] 10.222.0.66 "GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9" status: 200 len: 1755 microversion: 2.1 time: 0.214691 Jul 15 20:41:25.824229 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 314/629] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:41:25 2022] GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9 => generated 1755 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:41:26.424420 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-8a264d51-e925-4f3d-856e-2f1a19bd9828 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:41:26.425057 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-8a264d51-e925-4f3d-856e-2f1a19bd9828 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 943a9a49-4fcd-46a5-b444-1a94f490ae2e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:41:26.431472 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8a264d51-e925-4f3d-856e-2f1a19bd9828 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:26.431925 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8a264d51-e925-4f3d-856e-2f1a19bd9828 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:26.432722 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8a264d51-e925-4f3d-856e-2f1a19bd9828 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:26.433162 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8a264d51-e925-4f3d-856e-2f1a19bd9828 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:26.562084 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-8a264d51-e925-4f3d-856e-2f1a19bd9828 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:41:26.569898 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-8a264d51-e925-4f3d-856e-2f1a19bd9828 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e" status: 200 len: 1737 microversion: 2.1 time: 0.149462 Jul 15 20:41:26.570448 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 316/630] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:41:26 2022] GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:41:26.841862 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-c0b32284-9dce-4153-a088-e40a5e25cb13 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:41:26.842694 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-c0b32284-9dce-4153-a088-e40a5e25cb13 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] [instance: 67ed2b36-9422-4f98-8a39-83c214eadae9] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:41:26.849533 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c0b32284-9dce-4153-a088-e40a5e25cb13 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:26.849977 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c0b32284-9dce-4153-a088-e40a5e25cb13 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:26.850741 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c0b32284-9dce-4153-a088-e40a5e25cb13 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:26.851172 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c0b32284-9dce-4153-a088-e40a5e25cb13 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:26.988903 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-c0b32284-9dce-4153-a088-e40a5e25cb13 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a573525d244ab3ab69095db8871f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d62130d6f74b8e919e429cbb3afc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:41:26.996769 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-c0b32284-9dce-4153-a088-e40a5e25cb13 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] 10.222.0.66 "GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9" status: 200 len: 1755 microversion: 2.1 time: 0.158954 Jul 15 20:41:26.997328 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 315/631] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:41:26 2022] GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9 => generated 1755 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:41:27.586987 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-5bc9134a-6d0d-455f-87d5-b4c4138ca22b tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:41:27.587629 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-5bc9134a-6d0d-455f-87d5-b4c4138ca22b tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 943a9a49-4fcd-46a5-b444-1a94f490ae2e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:41:27.594855 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-5bc9134a-6d0d-455f-87d5-b4c4138ca22b tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:27.595306 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-5bc9134a-6d0d-455f-87d5-b4c4138ca22b tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:27.596068 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-5bc9134a-6d0d-455f-87d5-b4c4138ca22b tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:27.596533 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-5bc9134a-6d0d-455f-87d5-b4c4138ca22b tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:27.727456 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-5bc9134a-6d0d-455f-87d5-b4c4138ca22b tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:41:27.736664 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-5bc9134a-6d0d-455f-87d5-b4c4138ca22b tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e" status: 200 len: 1717 microversion: 2.1 time: 0.153438 Jul 15 20:41:27.737242 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 317/632] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:41:27 2022] GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e => generated 1717 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:41:27.839794 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-7ba068d7-ebaa-4545-b9c8-3616666f4dad tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:41:27.840291 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-7ba068d7-ebaa-4545-b9c8-3616666f4dad tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 943a9a49-4fcd-46a5-b444-1a94f490ae2e] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:41:27.847560 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7ba068d7-ebaa-4545-b9c8-3616666f4dad tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:27.848121 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7ba068d7-ebaa-4545-b9c8-3616666f4dad tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:27.848808 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7ba068d7-ebaa-4545-b9c8-3616666f4dad tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:27.849246 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7ba068d7-ebaa-4545-b9c8-3616666f4dad tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:27.936713 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.wsgi [None req-7ba068d7-ebaa-4545-b9c8-3616666f4dad tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] HTTP exception thrown: Cannot 'detach_volume' instance 943a9a49-4fcd-46a5-b444-1a94f490ae2e while it is in vm_state rescued Jul 15 20:41:27.938335 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-7ba068d7-ebaa-4545-b9c8-3616666f4dad tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Request method failure captured: Jul 15 20:41:27.938335 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: request: DELETE /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e/os-volume_attachments/5c5590bb-68e6-4803-8751-f4e5c10fae38 HTTP/1.1 Jul 15 20:41:27.938335 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Accept: application/json Jul 15 20:41:27.938335 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Accept-Encoding: identity Jul 15 20:41:27.938335 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Connection: close Jul 15 20:41:27.938335 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Content-Length: 0 Jul 15 20:41:27.938335 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Content-Type: application/json Jul 15 20:41:27.938335 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Host: 10.222.0.66 Jul 15 20:41:27.938335 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Openstack-System-Scope: None Jul 15 20:41:27.938335 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: User-Agent: python-urllib3/1.26.9 Jul 15 20:41:27.938335 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Auth-Token: gAAAAABi0c_lkbnVJwqH3IpbVZVWMQ8HLL8u6A1nS9xbrwR6NEMpzbfmtKxCTl345tuTNHTXVBkYUfn70H4FibX8wPsRThE1aLHTgYmYauzCicRFu1CJ8qFyi1jEF3aSJLDbXxeN4ZX8G4ZQcm6oZkgRw4bn00Q4s9ZTfchWhd2dhVKZ6EVvqgw Jul 15 20:41:27.938335 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Domain-Id: None Jul 15 20:41:27.938335 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Domain-Name: None Jul 15 20:41:27.938335 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Identity-Status: Confirmed Jul 15 20:41:27.938335 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Is-Admin-Project: True Jul 15 20:41:27.938335 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Domain-Id: default Jul 15 20:41:27.938335 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Domain-Name: Default Jul 15 20:41:27.938335 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Id: 0395d91380b34e968d7e39be3bc88b0f Jul 15 20:41:27.938335 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1747571758 Jul 15 20:41:27.938335 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Role: member,reader Jul 15 20:41:27.938335 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Roles: member,reader Jul 15 20:41:27.939981 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0395d91380b34e968d7e39be3bc88b0f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_0395d91380b34e968d7e39be3bc88b0f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0395d91380b34e968d7e39be3bc88b0f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/0395d91380b34e968d7e39be3bc88b0f"}]}] Jul 15 20:41:27.939981 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1747571758 Jul 15 20:41:27.939981 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Tenant-Id: 0395d91380b34e968d7e39be3bc88b0f Jul 15 20:41:27.939981 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1747571758 Jul 15 20:41:27.939981 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User: tempest-ServerRescueNegativeTestJSON-1747571758-project Jul 15 20:41:27.939981 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Domain-Id: default Jul 15 20:41:27.939981 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Domain-Name: Default Jul 15 20:41:27.939981 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Id: e13d5d7068e348248387b512c55dec5e Jul 15 20:41:27.939981 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1747571758-project Jul 15 20:41:27.939981 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: method: > Jul 15 20:41:27.939981 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: exception: Cannot 'detach_volume' instance 943a9a49-4fcd-46a5-b444-1a94f490ae2e while it is in vm_state rescued Jul 15 20:41:27.940795 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: action_args: {'server_id': '943a9a49-4fcd-46a5-b444-1a94f490ae2e', 'id': '5c5590bb-68e6-4803-8751-f4e5c10fae38'} Jul 15 20:41:27.940795 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 20:41:27.940795 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:41:27.940795 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 15 20:41:27.940795 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 15 20:41:27.940795 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 15 20:41:27.940795 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 15 20:41:27.940795 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 15 20:41:27.940795 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 15 20:41:27.940795 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 943a9a49-4fcd-46a5-b444-1a94f490ae2e in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 15 20:41:27.940795 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:41:27.940795 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:41:27.940795 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:41:27.940795 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:41:27.940795 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:41:27.940795 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:41:27.940795 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 20:41:27.940795 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 20:41:27.940795 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 20:41:27.940795 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 20:41:27.942205 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 15 20:41:27.942205 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 15 20:41:27.942205 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 15 20:41:27.942205 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 15 20:41:27.942205 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 943a9a49-4fcd-46a5-b444-1a94f490ae2e while it is in vm_state rescued Jul 15 20:41:27.942205 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:41:27.942205 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:41:27.942205 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:41:27.942205 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:41:27.942205 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:41:27.942205 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:41:27.942205 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 20:41:27.942205 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 20:41:27.942205 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 943a9a49-4fcd-46a5-b444-1a94f490ae2e while it is in vm_state rescued Jul 15 20:41:27.942205 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:41:27.942205 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-7ba068d7-ebaa-4545-b9c8-3616666f4dad tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Returning 409 to user: Cannot 'detach_volume' instance 943a9a49-4fcd-46a5-b444-1a94f490ae2e while it is in vm_state rescued {{(pid=124432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 20:41:27.944267 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-7ba068d7-ebaa-4545-b9c8-3616666f4dad tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "DELETE /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e/os-volume_attachments/5c5590bb-68e6-4803-8751-f4e5c10fae38" status: 409 len: 152 microversion: 2.1 time: 0.103972 Jul 15 20:41:27.944267 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 316/633] 10.222.0.66 () {58 vars in 1415 bytes} [Fri Jul 15 20:41:27 2022] DELETE /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e/os-volume_attachments/5c5590bb-68e6-4803-8751-f4e5c10fae38 => generated 152 bytes in 105 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 15 20:41:27.948750 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-9cfc14c4-9505-4f29-8be4-f5f516a2846a tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:41:27.949278 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-9cfc14c4-9505-4f29-8be4-f5f516a2846a tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 943a9a49-4fcd-46a5-b444-1a94f490ae2e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:41:27.956018 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-9cfc14c4-9505-4f29-8be4-f5f516a2846a tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:27.956488 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-9cfc14c4-9505-4f29-8be4-f5f516a2846a tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:27.957264 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-9cfc14c4-9505-4f29-8be4-f5f516a2846a tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:27.957693 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-9cfc14c4-9505-4f29-8be4-f5f516a2846a tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:28.014699 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-3c065201-fc91-4e05-a812-83ec2a634e03 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:41:28.015317 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-3c065201-fc91-4e05-a812-83ec2a634e03 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] [instance: 67ed2b36-9422-4f98-8a39-83c214eadae9] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:41:28.021789 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3c065201-fc91-4e05-a812-83ec2a634e03 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:28.022241 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3c065201-fc91-4e05-a812-83ec2a634e03 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:28.023009 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3c065201-fc91-4e05-a812-83ec2a634e03 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:28.023236 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-9cfc14c4-9505-4f29-8be4-f5f516a2846a tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "POST /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e/action" status: 202 len: 0 microversion: 2.1 time: 0.078238 Jul 15 20:41:28.023441 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3c065201-fc91-4e05-a812-83ec2a634e03 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:28.026918 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 318/634] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 15 20:41:27 2022] POST /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 20:41:28.032928 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-2fe08751-9feb-451b-824a-5ed06da66822 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:41:28.033617 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-2fe08751-9feb-451b-824a-5ed06da66822 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 943a9a49-4fcd-46a5-b444-1a94f490ae2e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:41:28.039874 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-2fe08751-9feb-451b-824a-5ed06da66822 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:28.040327 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-2fe08751-9feb-451b-824a-5ed06da66822 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:28.041389 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-2fe08751-9feb-451b-824a-5ed06da66822 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:28.041821 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-2fe08751-9feb-451b-824a-5ed06da66822 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:28.485441 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-3c065201-fc91-4e05-a812-83ec2a634e03 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a573525d244ab3ab69095db8871f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d62130d6f74b8e919e429cbb3afc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:41:28.492854 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-2fe08751-9feb-451b-824a-5ed06da66822 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:41:28.494352 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-3c065201-fc91-4e05-a812-83ec2a634e03 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] 10.222.0.66 "GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9" status: 200 len: 1758 microversion: 2.1 time: 0.484497 Jul 15 20:41:28.495005 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 317/635] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:41:28 2022] GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9 => generated 1758 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:41:28.505945 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:41:28.509418 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-2fe08751-9feb-451b-824a-5ed06da66822 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e" status: 200 len: 1725 microversion: 2.1 time: 0.481219 Jul 15 20:41:28.510006 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 319/636] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:41:28 2022] GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e => generated 1725 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:41:29.527051 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-ffb4e75e-1fbf-4781-9ca4-68867833d3f2 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:41:29.527685 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-ffb4e75e-1fbf-4781-9ca4-68867833d3f2 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 943a9a49-4fcd-46a5-b444-1a94f490ae2e] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:41:29.535314 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ffb4e75e-1fbf-4781-9ca4-68867833d3f2 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:29.535765 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ffb4e75e-1fbf-4781-9ca4-68867833d3f2 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:29.536563 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ffb4e75e-1fbf-4781-9ca4-68867833d3f2 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:29.536995 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ffb4e75e-1fbf-4781-9ca4-68867833d3f2 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:29.667409 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-ffb4e75e-1fbf-4781-9ca4-68867833d3f2 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:41:29.675861 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-ffb4e75e-1fbf-4781-9ca4-68867833d3f2 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e" status: 200 len: 1725 microversion: 2.1 time: 0.152652 Jul 15 20:41:29.676436 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 318/637] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:41:29 2022] GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:41:30.160135 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-133aa526-1c07-41a5-abfd-01057871d88d tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:41:30.160665 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-133aa526-1c07-41a5-abfd-01057871d88d tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:41:30.168424 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-133aa526-1c07-41a5-abfd-01057871d88d tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:30.168827 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-133aa526-1c07-41a5-abfd-01057871d88d tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:30.170161 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-133aa526-1c07-41a5-abfd-01057871d88d tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:30.170711 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-133aa526-1c07-41a5-abfd-01057871d88d tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:30.251106 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.objects.instance [None req-133aa526-1c07-41a5-abfd-01057871d88d tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lazy-loading 'services' on Instance uuid 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e {{(pid=124430) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 20:41:30.323858 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-133aa526-1c07-41a5-abfd-01057871d88d tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "DELETE /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e/os-volume_attachments/ccd29187-ca61-4108-bb58-990735c5b3dd" status: 202 len: 0 microversion: 2.1 time: 0.167691 Jul 15 20:41:30.324491 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 320/638] 10.222.0.66 () {58 vars in 1415 bytes} [Fri Jul 15 20:41:30 2022] DELETE /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e/os-volume_attachments/ccd29187-ca61-4108-bb58-990735c5b3dd => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 20:41:30.693089 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-f9e33138-6d27-4169-94d2-777c2d2d55a9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:41:30.693687 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-f9e33138-6d27-4169-94d2-777c2d2d55a9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 943a9a49-4fcd-46a5-b444-1a94f490ae2e] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:41:30.700119 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f9e33138-6d27-4169-94d2-777c2d2d55a9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:30.701283 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f9e33138-6d27-4169-94d2-777c2d2d55a9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:30.702135 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f9e33138-6d27-4169-94d2-777c2d2d55a9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:30.702585 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f9e33138-6d27-4169-94d2-777c2d2d55a9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:30.835357 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-f9e33138-6d27-4169-94d2-777c2d2d55a9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:41:30.843555 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-f9e33138-6d27-4169-94d2-777c2d2d55a9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e" status: 200 len: 1725 microversion: 2.1 time: 0.154377 Jul 15 20:41:30.844146 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 319/639] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:41:30 2022] GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:41:31.862359 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-273a0acf-6269-4019-be81-309f76cd74b9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:41:31.863055 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-273a0acf-6269-4019-be81-309f76cd74b9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 943a9a49-4fcd-46a5-b444-1a94f490ae2e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:41:31.869284 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-273a0acf-6269-4019-be81-309f76cd74b9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:31.869727 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-273a0acf-6269-4019-be81-309f76cd74b9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:31.870476 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-273a0acf-6269-4019-be81-309f76cd74b9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:31.870980 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-273a0acf-6269-4019-be81-309f76cd74b9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:32.000999 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-273a0acf-6269-4019-be81-309f76cd74b9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:41:32.008765 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-273a0acf-6269-4019-be81-309f76cd74b9 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e" status: 200 len: 1731 microversion: 2.1 time: 0.152494 Jul 15 20:41:32.009318 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 321/640] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:41:31 2022] GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:41:32.025576 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-da692cb1-6c60-4f2f-8256-8a6043a8f6e6 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:41:32.026074 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-da692cb1-6c60-4f2f-8256-8a6043a8f6e6 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 943a9a49-4fcd-46a5-b444-1a94f490ae2e] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:41:32.032994 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-da692cb1-6c60-4f2f-8256-8a6043a8f6e6 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:32.033438 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-da692cb1-6c60-4f2f-8256-8a6043a8f6e6 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:32.034195 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-da692cb1-6c60-4f2f-8256-8a6043a8f6e6 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:32.034625 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-da692cb1-6c60-4f2f-8256-8a6043a8f6e6 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:32.110509 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-da692cb1-6c60-4f2f-8256-8a6043a8f6e6 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089011 Jul 15 20:41:32.111100 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 320/641] 10.222.0.66 () {58 vars in 1274 bytes} [Fri Jul 15 20:41:32 2022] GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:41:32.500973 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-dd1159e0-84e2-4417-b44a-35b045d47a59 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:41:32.507263 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-dd1159e0-84e2-4417-b44a-35b045d47a59 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:32.507717 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-dd1159e0-84e2-4417-b44a-35b045d47a59 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:32.568175 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-dd1159e0-84e2-4417-b44a-35b045d47a59 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e] Going to try to stop instance {{(pid=124430) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 15 20:41:32.612714 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-dd1159e0-84e2-4417-b44a-35b045d47a59 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "POST /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e/action" status: 202 len: 0 microversion: 2.1 time: 0.116160 Jul 15 20:41:32.613767 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 322/642] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 15 20:41:32 2022] POST /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 20:41:32.622061 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-ebe55e51-4b72-44f7-9293-d997e905e4cd tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:41:32.623453 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-ebe55e51-4b72-44f7-9293-d997e905e4cd tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:41:32.630034 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ebe55e51-4b72-44f7-9293-d997e905e4cd tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:32.630533 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ebe55e51-4b72-44f7-9293-d997e905e4cd tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:32.631352 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ebe55e51-4b72-44f7-9293-d997e905e4cd tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:32.631786 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ebe55e51-4b72-44f7-9293-d997e905e4cd tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:32.849122 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-ebe55e51-4b72-44f7-9293-d997e905e4cd tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d12a685d9b419fa3606b5f4d1309fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af209f962144de4ae7e3575a3890096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:41:32.857027 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-ebe55e51-4b72-44f7-9293-d997e905e4cd tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e" status: 200 len: 1675 microversion: 2.1 time: 0.238773 Jul 15 20:41:32.857626 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 321/643] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:41:32 2022] GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e => generated 1675 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:41:33.074730 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [req-eded9967-d29f-4253-830c-24775c51484b req-e56b3ca8-73b9-431f-a6c5-64baf5fd4e2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "943a9a49-4fcd-46a5-b444-1a94f490ae2e", "tag": "96d2f7c9-c3d8-4750-b9d0-3ab318ff06a1"}]} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:41:33.084675 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-eded9967-d29f-4253-830c-24775c51484b req-e56b3ca8-73b9-431f-a6c5-64baf5fd4e2c service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:33.085131 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-eded9967-d29f-4253-830c-24775c51484b req-e56b3ca8-73b9-431f-a6c5-64baf5fd4e2c service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:33.096293 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.compute.server_external_events [req-eded9967-d29f-4253-830c-24775c51484b req-e56b3ca8-73b9-431f-a6c5-64baf5fd4e2c service nova] Creating event network-changed:96d2f7c9-c3d8-4750-b9d0-3ab318ff06a1 for instance 943a9a49-4fcd-46a5-b444-1a94f490ae2e on hv-cinder-79987 Jul 15 20:41:33.101093 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [req-eded9967-d29f-4253-830c-24775c51484b req-e56b3ca8-73b9-431f-a6c5-64baf5fd4e2c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030390 Jul 15 20:41:33.101669 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 323/644] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:41:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:41:33.874500 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-8acd0eb8-ba7d-4510-b26e-2444d840b034 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:41:33.875248 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-8acd0eb8-ba7d-4510-b26e-2444d840b034 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:41:33.881903 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8acd0eb8-ba7d-4510-b26e-2444d840b034 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:33.882345 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8acd0eb8-ba7d-4510-b26e-2444d840b034 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:33.883716 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8acd0eb8-ba7d-4510-b26e-2444d840b034 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:33.884167 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8acd0eb8-ba7d-4510-b26e-2444d840b034 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:34.026138 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-8acd0eb8-ba7d-4510-b26e-2444d840b034 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d12a685d9b419fa3606b5f4d1309fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af209f962144de4ae7e3575a3890096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:41:34.034564 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-8acd0eb8-ba7d-4510-b26e-2444d840b034 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e" status: 200 len: 1675 microversion: 2.1 time: 0.164768 Jul 15 20:41:34.035128 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 322/645] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:41:33 2022] GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e => generated 1675 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:41:35.053801 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-8e5624c2-4896-4cab-873c-ae8fc4fb4cbc tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:41:35.054760 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-8e5624c2-4896-4cab-873c-ae8fc4fb4cbc tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:41:35.060992 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8e5624c2-4896-4cab-873c-ae8fc4fb4cbc tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:35.061432 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8e5624c2-4896-4cab-873c-ae8fc4fb4cbc tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:35.062183 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8e5624c2-4896-4cab-873c-ae8fc4fb4cbc tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:35.062611 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8e5624c2-4896-4cab-873c-ae8fc4fb4cbc tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:35.115687 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-8fa21509-6a79-43a2-a9c3-14ac82958048 req-94866b66-e23d-4520-93a0-1eeb448bf8c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "943a9a49-4fcd-46a5-b444-1a94f490ae2e", "tag": "96d2f7c9-c3d8-4750-b9d0-3ab318ff06a1"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:41:35.124323 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-8fa21509-6a79-43a2-a9c3-14ac82958048 req-94866b66-e23d-4520-93a0-1eeb448bf8c4 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:35.124805 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-8fa21509-6a79-43a2-a9c3-14ac82958048 req-94866b66-e23d-4520-93a0-1eeb448bf8c4 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:35.135423 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-8fa21509-6a79-43a2-a9c3-14ac82958048 req-94866b66-e23d-4520-93a0-1eeb448bf8c4 service nova] Creating event network-changed:96d2f7c9-c3d8-4750-b9d0-3ab318ff06a1 for instance 943a9a49-4fcd-46a5-b444-1a94f490ae2e on hv-cinder-79987 Jul 15 20:41:35.140637 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-8fa21509-6a79-43a2-a9c3-14ac82958048 req-94866b66-e23d-4520-93a0-1eeb448bf8c4 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028475 Jul 15 20:41:35.141260 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 323/646] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:41:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 20:41:35.203001 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-8e5624c2-4896-4cab-873c-ae8fc4fb4cbc tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d12a685d9b419fa3606b5f4d1309fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af209f962144de4ae7e3575a3890096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:41:35.211125 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-8e5624c2-4896-4cab-873c-ae8fc4fb4cbc tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e" status: 200 len: 1675 microversion: 2.1 time: 0.162070 Jul 15 20:41:35.211691 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 324/647] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:41:35 2022] GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e => generated 1675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:41:36.230425 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-883a5136-ff2a-4185-838c-26d55ee5da87 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:41:36.231115 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-883a5136-ff2a-4185-838c-26d55ee5da87 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:41:36.233603 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_api:SELECT=54 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:41:36.239228 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-883a5136-ff2a-4185-838c-26d55ee5da87 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:36.239543 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-883a5136-ff2a-4185-838c-26d55ee5da87 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:36.240300 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-883a5136-ff2a-4185-838c-26d55ee5da87 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:36.240759 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-883a5136-ff2a-4185-838c-26d55ee5da87 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:36.261241 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell1:SELECT=100 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:41:36.375574 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-883a5136-ff2a-4185-838c-26d55ee5da87 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d12a685d9b419fa3606b5f4d1309fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af209f962144de4ae7e3575a3890096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:41:36.383081 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-883a5136-ff2a-4185-838c-26d55ee5da87 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e" status: 200 len: 1675 microversion: 2.1 time: 0.157312 Jul 15 20:41:36.383788 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 324/648] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:41:36 2022] GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:41:37.399074 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-30cd0c2c-f310-418e-9cc1-d6296abdbadc tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:41:37.399685 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-30cd0c2c-f310-418e-9cc1-d6296abdbadc tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:41:37.406852 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-30cd0c2c-f310-418e-9cc1-d6296abdbadc tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:37.407308 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-30cd0c2c-f310-418e-9cc1-d6296abdbadc tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:37.408159 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-30cd0c2c-f310-418e-9cc1-d6296abdbadc tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:37.408644 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-30cd0c2c-f310-418e-9cc1-d6296abdbadc tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:37.538729 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-30cd0c2c-f310-418e-9cc1-d6296abdbadc tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d12a685d9b419fa3606b5f4d1309fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af209f962144de4ae7e3575a3890096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:41:37.547268 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-30cd0c2c-f310-418e-9cc1-d6296abdbadc tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e" status: 200 len: 1675 microversion: 2.1 time: 0.152090 Jul 15 20:41:37.547831 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 325/649] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:41:37 2022] GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:41:38.564289 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-fe69116f-7056-4c57-a378-9c3222694525 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:41:38.564922 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-fe69116f-7056-4c57-a378-9c3222694525 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:41:38.571388 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fe69116f-7056-4c57-a378-9c3222694525 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:38.571864 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fe69116f-7056-4c57-a378-9c3222694525 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:38.572659 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fe69116f-7056-4c57-a378-9c3222694525 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:38.573091 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fe69116f-7056-4c57-a378-9c3222694525 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:38.699779 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-fe69116f-7056-4c57-a378-9c3222694525 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d12a685d9b419fa3606b5f4d1309fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af209f962144de4ae7e3575a3890096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:41:38.707989 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-fe69116f-7056-4c57-a378-9c3222694525 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e" status: 200 len: 1675 microversion: 2.1 time: 0.147510 Jul 15 20:41:38.708587 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 325/650] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:41:38 2022] GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e => generated 1675 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:41:39.725195 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-b48ae4a8-e7c9-45df-986a-5c3cbb220d93 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:41:39.725735 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-b48ae4a8-e7c9-45df-986a-5c3cbb220d93 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:41:39.732308 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b48ae4a8-e7c9-45df-986a-5c3cbb220d93 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:39.732794 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b48ae4a8-e7c9-45df-986a-5c3cbb220d93 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:39.733557 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b48ae4a8-e7c9-45df-986a-5c3cbb220d93 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:39.733996 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b48ae4a8-e7c9-45df-986a-5c3cbb220d93 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:39.867770 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-b48ae4a8-e7c9-45df-986a-5c3cbb220d93 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d12a685d9b419fa3606b5f4d1309fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af209f962144de4ae7e3575a3890096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:41:39.876179 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-b48ae4a8-e7c9-45df-986a-5c3cbb220d93 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e" status: 200 len: 1675 microversion: 2.1 time: 0.154951 Jul 15 20:41:39.876774 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 326/651] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:41:39 2022] GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:41:40.893142 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-a34fdc20-a75b-4f30-acd6-1374046f914d tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:41:40.893747 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-a34fdc20-a75b-4f30-acd6-1374046f914d tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:41:40.900489 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a34fdc20-a75b-4f30-acd6-1374046f914d tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:40.900945 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a34fdc20-a75b-4f30-acd6-1374046f914d tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:40.901713 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a34fdc20-a75b-4f30-acd6-1374046f914d tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:40.902175 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a34fdc20-a75b-4f30-acd6-1374046f914d tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:41.184563 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-a34fdc20-a75b-4f30-acd6-1374046f914d tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d12a685d9b419fa3606b5f4d1309fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af209f962144de4ae7e3575a3890096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:41:41.192233 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-a34fdc20-a75b-4f30-acd6-1374046f914d tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e" status: 200 len: 1675 microversion: 2.1 time: 0.302934 Jul 15 20:41:41.192820 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 326/652] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:41:40 2022] GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e => generated 1675 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:41:42.209135 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-44bd5d80-5f79-4f1b-8e16-f344088bfbcd tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:41:42.209741 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-44bd5d80-5f79-4f1b-8e16-f344088bfbcd tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:41:42.216484 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-44bd5d80-5f79-4f1b-8e16-f344088bfbcd tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:42.216938 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-44bd5d80-5f79-4f1b-8e16-f344088bfbcd tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:42.217756 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-44bd5d80-5f79-4f1b-8e16-f344088bfbcd tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:42.218197 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-44bd5d80-5f79-4f1b-8e16-f344088bfbcd tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:42.350676 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-44bd5d80-5f79-4f1b-8e16-f344088bfbcd tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d12a685d9b419fa3606b5f4d1309fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af209f962144de4ae7e3575a3890096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:41:42.359249 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-44bd5d80-5f79-4f1b-8e16-f344088bfbcd tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e" status: 200 len: 1675 microversion: 2.1 time: 0.153922 Jul 15 20:41:42.359816 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 327/653] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:41:42 2022] GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:41:43.378657 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-52eb0d46-0782-4036-832b-551ceadf4975 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:41:43.379286 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-52eb0d46-0782-4036-832b-551ceadf4975 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:41:43.385483 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-52eb0d46-0782-4036-832b-551ceadf4975 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:43.385939 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-52eb0d46-0782-4036-832b-551ceadf4975 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:43.386700 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-52eb0d46-0782-4036-832b-551ceadf4975 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:43.387135 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-52eb0d46-0782-4036-832b-551ceadf4975 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:43.522605 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-52eb0d46-0782-4036-832b-551ceadf4975 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d12a685d9b419fa3606b5f4d1309fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af209f962144de4ae7e3575a3890096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:41:43.530304 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-52eb0d46-0782-4036-832b-551ceadf4975 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e" status: 200 len: 1675 microversion: 2.1 time: 0.157269 Jul 15 20:41:43.530891 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 327/654] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:41:43 2022] GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:41:44.547762 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-ea76d397-3558-460a-ac70-9b4d80749487 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:41:44.548295 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-ea76d397-3558-460a-ac70-9b4d80749487 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:41:44.551731 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_api:SELECT=48 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:41:44.557865 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-ea76d397-3558-460a-ac70-9b4d80749487 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:44.558313 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-ea76d397-3558-460a-ac70-9b4d80749487 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:44.559070 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-ea76d397-3558-460a-ac70-9b4d80749487 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:44.559534 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-ea76d397-3558-460a-ac70-9b4d80749487 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:44.738995 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-ea76d397-3558-460a-ac70-9b4d80749487 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d12a685d9b419fa3606b5f4d1309fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af209f962144de4ae7e3575a3890096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:41:44.746618 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-ea76d397-3558-460a-ac70-9b4d80749487 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e" status: 200 len: 1675 microversion: 2.1 time: 0.202860 Jul 15 20:41:44.747178 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 328/655] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:41:44 2022] GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e => generated 1675 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:41:45.764372 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-0b8342e6-d035-4896-a2c1-17265f74afee tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:41:45.764928 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-0b8342e6-d035-4896-a2c1-17265f74afee tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:41:45.771407 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0b8342e6-d035-4896-a2c1-17265f74afee tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:45.771845 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0b8342e6-d035-4896-a2c1-17265f74afee tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:45.772639 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0b8342e6-d035-4896-a2c1-17265f74afee tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:45.773066 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0b8342e6-d035-4896-a2c1-17265f74afee tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:45.903297 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-0b8342e6-d035-4896-a2c1-17265f74afee tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d12a685d9b419fa3606b5f4d1309fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af209f962144de4ae7e3575a3890096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:41:45.910748 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-0b8342e6-d035-4896-a2c1-17265f74afee tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e" status: 200 len: 1675 microversion: 2.1 time: 0.150987 Jul 15 20:41:45.911299 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 328/656] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:41:45 2022] GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:41:46.841704 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-62f4720c-22a2-4b83-a29d-fa6263acf50f tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:41:46.842290 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-62f4720c-22a2-4b83-a29d-fa6263acf50f tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 4ffccc9e-10cc-413f-ac60-518d6541968a] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:41:46.849111 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-62f4720c-22a2-4b83-a29d-fa6263acf50f tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:46.849612 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-62f4720c-22a2-4b83-a29d-fa6263acf50f tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:46.850384 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-62f4720c-22a2-4b83-a29d-fa6263acf50f tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:46.850822 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-62f4720c-22a2-4b83-a29d-fa6263acf50f tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:46.874987 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-62f4720c-22a2-4b83-a29d-fa6263acf50f tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/4ffccc9e-10cc-413f-ac60-518d6541968a/ips" status: 200 len: 151 microversion: 2.1 time: 0.037411 Jul 15 20:41:46.875603 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 329/657] 10.222.0.66 () {58 vars in 1247 bytes} [Fri Jul 15 20:41:46 2022] GET /compute/v2.1/servers/4ffccc9e-10cc-413f-ac60-518d6541968a/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:41:46.928356 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-f2fd43f7-69c9-4fdc-a703-adfeb90f9b58 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:41:46.929051 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-f2fd43f7-69c9-4fdc-a703-adfeb90f9b58 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:41:46.936685 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f2fd43f7-69c9-4fdc-a703-adfeb90f9b58 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:46.937144 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f2fd43f7-69c9-4fdc-a703-adfeb90f9b58 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:46.937907 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f2fd43f7-69c9-4fdc-a703-adfeb90f9b58 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:46.938345 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f2fd43f7-69c9-4fdc-a703-adfeb90f9b58 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:47.070263 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-f2fd43f7-69c9-4fdc-a703-adfeb90f9b58 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d12a685d9b419fa3606b5f4d1309fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af209f962144de4ae7e3575a3890096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:41:47.079022 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-f2fd43f7-69c9-4fdc-a703-adfeb90f9b58 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e" status: 200 len: 1675 microversion: 2.1 time: 0.154361 Jul 15 20:41:47.079952 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 329/658] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:41:46 2022] GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:41:48.096922 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-1b38bfa4-d5c1-4408-960e-2eb7329fa3b4 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:41:48.097566 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-1b38bfa4-d5c1-4408-960e-2eb7329fa3b4 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:41:48.104120 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-1b38bfa4-d5c1-4408-960e-2eb7329fa3b4 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:48.104605 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-1b38bfa4-d5c1-4408-960e-2eb7329fa3b4 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:48.105371 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-1b38bfa4-d5c1-4408-960e-2eb7329fa3b4 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:48.105808 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-1b38bfa4-d5c1-4408-960e-2eb7329fa3b4 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:48.198600 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-28ee6657-c357-4666-b1f3-9ef9cca0cffc tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a9a8b875-337b-4a62-8afc-2801dd492e8b"}} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:41:48.199816 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-28ee6657-c357-4666-b1f3-9ef9cca0cffc tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 4ffccc9e-10cc-413f-ac60-518d6541968a] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:41:48.207055 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-28ee6657-c357-4666-b1f3-9ef9cca0cffc tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:48.207493 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-28ee6657-c357-4666-b1f3-9ef9cca0cffc tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:48.208257 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-28ee6657-c357-4666-b1f3-9ef9cca0cffc tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:48.208709 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-28ee6657-c357-4666-b1f3-9ef9cca0cffc tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:48.242057 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-1b38bfa4-d5c1-4408-960e-2eb7329fa3b4 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d12a685d9b419fa3606b5f4d1309fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af209f962144de4ae7e3575a3890096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:41:48.250299 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-1b38bfa4-d5c1-4408-960e-2eb7329fa3b4 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e" status: 200 len: 1652 microversion: 2.1 time: 0.157028 Jul 15 20:41:48.251486 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 330/659] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:41:48 2022] GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e => generated 1652 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:41:48.268940 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-693fe749-5594-49a3-a26a-82e400ddfeab tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:41:48.277524 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-693fe749-5594-49a3-a26a-82e400ddfeab tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:48.277964 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-693fe749-5594-49a3-a26a-82e400ddfeab tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:48.304297 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-693fe749-5594-49a3-a26a-82e400ddfeab tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e] Going to try to start instance {{(pid=124430) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 15 20:41:48.358107 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-693fe749-5594-49a3-a26a-82e400ddfeab tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "POST /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e/action" status: 202 len: 0 microversion: 2.1 time: 0.093420 Jul 15 20:41:48.359028 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 331/660] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 15 20:41:48 2022] POST /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 15 20:41:48.369052 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-7199004f-d2f5-4422-b083-1459c1d64104 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:41:48.370008 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-7199004f-d2f5-4422-b083-1459c1d64104 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:41:48.378879 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-7199004f-d2f5-4422-b083-1459c1d64104 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:48.379352 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-7199004f-d2f5-4422-b083-1459c1d64104 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:48.380743 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-7199004f-d2f5-4422-b083-1459c1d64104 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:48.381188 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-7199004f-d2f5-4422-b083-1459c1d64104 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:48.521718 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-28ee6657-c357-4666-b1f3-9ef9cca0cffc tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "POST /compute/v2.1/servers/4ffccc9e-10cc-413f-ac60-518d6541968a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.326917 Jul 15 20:41:48.527872 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 330/661] 10.222.0.66 () {60 vars in 1322 bytes} [Fri Jul 15 20:41:48 2022] POST /compute/v2.1/servers/4ffccc9e-10cc-413f-ac60-518d6541968a/os-volume_attachments => generated 194 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 20:41:48.538165 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-7199004f-d2f5-4422-b083-1459c1d64104 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d12a685d9b419fa3606b5f4d1309fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af209f962144de4ae7e3575a3890096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:41:48.547128 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-7199004f-d2f5-4422-b083-1459c1d64104 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e" status: 200 len: 1661 microversion: 2.1 time: 0.182743 Jul 15 20:41:48.556723 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 332/662] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:41:48 2022] GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e => generated 1661 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:41:49.565736 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-9e8d5140-12b9-4b1d-84ad-7294593fe919 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:41:49.566435 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-9e8d5140-12b9-4b1d-84ad-7294593fe919 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:41:49.572716 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9e8d5140-12b9-4b1d-84ad-7294593fe919 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:49.573169 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9e8d5140-12b9-4b1d-84ad-7294593fe919 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:49.573958 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9e8d5140-12b9-4b1d-84ad-7294593fe919 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:49.574395 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9e8d5140-12b9-4b1d-84ad-7294593fe919 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:49.704016 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-9e8d5140-12b9-4b1d-84ad-7294593fe919 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d12a685d9b419fa3606b5f4d1309fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af209f962144de4ae7e3575a3890096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:41:49.711482 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-9e8d5140-12b9-4b1d-84ad-7294593fe919 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e" status: 200 len: 1661 microversion: 2.1 time: 0.150513 Jul 15 20:41:49.711990 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 331/663] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:41:49 2022] GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e => generated 1661 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:41:50.729256 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-5f2d44ce-5d74-41a4-adaa-46a1060b7778 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:41:50.729880 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-5f2d44ce-5d74-41a4-adaa-46a1060b7778 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:41:50.735980 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-5f2d44ce-5d74-41a4-adaa-46a1060b7778 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:50.736456 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-5f2d44ce-5d74-41a4-adaa-46a1060b7778 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:50.737240 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-5f2d44ce-5d74-41a4-adaa-46a1060b7778 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:50.737657 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-5f2d44ce-5d74-41a4-adaa-46a1060b7778 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:50.871006 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-5f2d44ce-5d74-41a4-adaa-46a1060b7778 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d12a685d9b419fa3606b5f4d1309fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af209f962144de4ae7e3575a3890096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:41:50.879155 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-5f2d44ce-5d74-41a4-adaa-46a1060b7778 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e" status: 200 len: 1665 microversion: 2.1 time: 0.153851 Jul 15 20:41:50.879713 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 333/664] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:41:50 2022] GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e => generated 1665 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:41:56.173384 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-4cdddbcc-f8f8-4069-abb1-519c323904ab tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a9a8b875-337b-4a62-8afc-2801dd492e8b"}} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:41:56.174020 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-4cdddbcc-f8f8-4069-abb1-519c323904ab tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 4ffccc9e-10cc-413f-ac60-518d6541968a] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:41:56.180881 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4cdddbcc-f8f8-4069-abb1-519c323904ab tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:56.181320 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4cdddbcc-f8f8-4069-abb1-519c323904ab tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:56.182073 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4cdddbcc-f8f8-4069-abb1-519c323904ab tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:56.182500 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4cdddbcc-f8f8-4069-abb1-519c323904ab tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:56.259878 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.wsgi [None req-4cdddbcc-f8f8-4069-abb1-519c323904ab tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] HTTP exception thrown: Invalid volume: volume a9a8b875-337b-4a62-8afc-2801dd492e8b is already attached to instances: 4ffccc9e-10cc-413f-ac60-518d6541968a Jul 15 20:41:56.261687 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-4cdddbcc-f8f8-4069-abb1-519c323904ab tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Request method failure captured: Jul 15 20:41:56.261687 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: request: POST /compute/v2.1/servers/4ffccc9e-10cc-413f-ac60-518d6541968a/os-volume_attachments HTTP/1.1 Jul 15 20:41:56.261687 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Accept: application/json Jul 15 20:41:56.261687 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Accept-Encoding: identity Jul 15 20:41:56.261687 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Connection: close Jul 15 20:41:56.261687 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Content-Length: 74 Jul 15 20:41:56.261687 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Content-Type: application/json Jul 15 20:41:56.261687 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Host: 10.222.0.66 Jul 15 20:41:56.261687 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Openstack-System-Scope: None Jul 15 20:41:56.261687 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: User-Agent: python-urllib3/1.26.9 Jul 15 20:41:56.261687 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Auth-Token: gAAAAABi0c_kH9ys3aP35h1LWWw3r1ieyA8CI0v0WIPPxjHmBB6aGubC4LmfLrm23mJ8HvmdkzR7wDAmSNK2w9OIr-gnn6Blv4WbaRzcu_QA8HGYGiqbz987b1vb5xUWoBYf2fTfD1m5oPgbP0g7S9YRfksUIFxkz4MW4lkoTMD9FFmUr-jPyfM Jul 15 20:41:56.261687 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Domain-Id: None Jul 15 20:41:56.261687 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Domain-Name: None Jul 15 20:41:56.261687 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Identity-Status: Confirmed Jul 15 20:41:56.261687 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Is-Admin-Project: True Jul 15 20:41:56.261687 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Domain-Id: default Jul 15 20:41:56.261687 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Domain-Name: Default Jul 15 20:41:56.261687 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Id: 78a593e163e74a7b9db61133e5c22035 Jul 15 20:41:56.261687 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Name: tempest-AttachVolumeNegativeTest-846080947 Jul 15 20:41:56.261687 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Role: member,reader Jul 15 20:41:56.261687 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Roles: member,reader Jul 15 20:41:56.263284 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/78a593e163e74a7b9db61133e5c22035"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_78a593e163e74a7b9db61133e5c22035"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/78a593e163e74a7b9db61133e5c22035"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/78a593e163e74a7b9db61133e5c22035"}]}] Jul 15 20:41:56.263284 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Tenant: tempest-AttachVolumeNegativeTest-846080947 Jul 15 20:41:56.263284 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Tenant-Id: 78a593e163e74a7b9db61133e5c22035 Jul 15 20:41:56.263284 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-846080947 Jul 15 20:41:56.263284 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User: tempest-AttachVolumeNegativeTest-846080947-project Jul 15 20:41:56.263284 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Domain-Id: default Jul 15 20:41:56.263284 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Domain-Name: Default Jul 15 20:41:56.263284 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Id: c0b5962b37b2470099436609425f7423 Jul 15 20:41:56.263284 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Name: tempest-AttachVolumeNegativeTest-846080947-project Jul 15 20:41:56.263284 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Jul 15 20:41:56.263284 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: {"volumeAttachment": {"volumeId": "a9a8b875-337b-4a62-8afc-2801dd492e8b"}} Jul 15 20:41:56.263284 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: method: > Jul 15 20:41:56.264169 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: exception: Invalid volume: volume a9a8b875-337b-4a62-8afc-2801dd492e8b is already attached to instances: 4ffccc9e-10cc-413f-ac60-518d6541968a Jul 15 20:41:56.264169 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: action_args: {'server_id': '4ffccc9e-10cc-413f-ac60-518d6541968a', 'body': {'volumeAttachment': {'volumeId': 'a9a8b875-337b-4a62-8afc-2801dd492e8b'}}} Jul 15 20:41:56.264169 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 20:41:56.264169 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:41:56.264169 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 15 20:41:56.264169 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 15 20:41:56.264169 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 15 20:41:56.264169 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 15 20:41:56.264169 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 15 20:41:56.264169 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 15 20:41:56.264169 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 15 20:41:56.264169 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 15 20:41:56.264169 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 15 20:41:56.264169 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 15 20:41:56.264169 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a9a8b875-337b-4a62-8afc-2801dd492e8b is already attached to instances: 4ffccc9e-10cc-413f-ac60-518d6541968a Jul 15 20:41:56.264169 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:41:56.264169 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:41:56.264169 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:41:56.264169 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:41:56.265589 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:41:56.265589 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:41:56.265589 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 20:41:56.265589 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 20:41:56.265589 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 20:41:56.265589 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 20:41:56.265589 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 15 20:41:56.265589 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 15 20:41:56.265589 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 15 20:41:56.265589 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 15 20:41:56.265589 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 15 20:41:56.265589 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 15 20:41:56.265589 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 15 20:41:56.265589 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 15 20:41:56.265589 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a9a8b875-337b-4a62-8afc-2801dd492e8b is already attached to instances: 4ffccc9e-10cc-413f-ac60-518d6541968a Jul 15 20:41:56.265589 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:41:56.265589 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:41:56.265589 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:41:56.265589 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:41:56.265589 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:41:56.267040 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:41:56.267040 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 20:41:56.267040 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 20:41:56.267040 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a9a8b875-337b-4a62-8afc-2801dd492e8b is already attached to instances: 4ffccc9e-10cc-413f-ac60-518d6541968a Jul 15 20:41:56.267040 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:41:56.267040 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-4cdddbcc-f8f8-4069-abb1-519c323904ab tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Returning 400 to user: Invalid volume: volume a9a8b875-337b-4a62-8afc-2801dd492e8b is already attached to instances: 4ffccc9e-10cc-413f-ac60-518d6541968a {{(pid=124432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 20:41:56.267040 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-4cdddbcc-f8f8-4069-abb1-519c323904ab tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "POST /compute/v2.1/servers/4ffccc9e-10cc-413f-ac60-518d6541968a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095050 Jul 15 20:41:56.267040 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 332/665] 10.222.0.66 () {60 vars in 1322 bytes} [Fri Jul 15 20:41:56 2022] POST /compute/v2.1/servers/4ffccc9e-10cc-413f-ac60-518d6541968a/os-volume_attachments => generated 174 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 15 20:41:56.324374 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-b4bec83b-2b00-4ebf-9011-a885cb58086e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:41:56.324876 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-b4bec83b-2b00-4ebf-9011-a885cb58086e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 4ffccc9e-10cc-413f-ac60-518d6541968a] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:41:56.331910 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b4bec83b-2b00-4ebf-9011-a885cb58086e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:56.332360 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b4bec83b-2b00-4ebf-9011-a885cb58086e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:56.333148 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b4bec83b-2b00-4ebf-9011-a885cb58086e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:56.333584 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b4bec83b-2b00-4ebf-9011-a885cb58086e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:56.411275 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:41:56.415331 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.objects.instance [None req-b4bec83b-2b00-4ebf-9011-a885cb58086e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lazy-loading 'services' on Instance uuid 4ffccc9e-10cc-413f-ac60-518d6541968a {{(pid=124430) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 20:41:56.500986 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-b4bec83b-2b00-4ebf-9011-a885cb58086e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "DELETE /compute/v2.1/servers/4ffccc9e-10cc-413f-ac60-518d6541968a/os-volume_attachments/a9a8b875-337b-4a62-8afc-2801dd492e8b" status: 202 len: 0 microversion: 2.1 time: 0.180236 Jul 15 20:41:56.501654 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 334/666] 10.222.0.66 () {58 vars in 1415 bytes} [Fri Jul 15 20:41:56 2022] DELETE /compute/v2.1/servers/4ffccc9e-10cc-413f-ac60-518d6541968a/os-volume_attachments/a9a8b875-337b-4a62-8afc-2801dd492e8b => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 20:41:56.509870 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-1c103bad-16ba-4848-bd77-69fc89e92d72 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:41:56.510781 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-1c103bad-16ba-4848-bd77-69fc89e92d72 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 4ffccc9e-10cc-413f-ac60-518d6541968a] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:41:56.517625 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1c103bad-16ba-4848-bd77-69fc89e92d72 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:56.518074 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1c103bad-16ba-4848-bd77-69fc89e92d72 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:56.518887 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1c103bad-16ba-4848-bd77-69fc89e92d72 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:56.519290 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1c103bad-16ba-4848-bd77-69fc89e92d72 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:56.550257 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-1c103bad-16ba-4848-bd77-69fc89e92d72 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/4ffccc9e-10cc-413f-ac60-518d6541968a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044217 Jul 15 20:41:56.551103 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 333/667] 10.222.0.66 () {58 vars in 1301 bytes} [Fri Jul 15 20:41:56 2022] GET /compute/v2.1/servers/4ffccc9e-10cc-413f-ac60-518d6541968a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:41:57.563301 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-79e264a6-616b-4ccd-881b-62b2884cf44e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:41:57.564364 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-79e264a6-616b-4ccd-881b-62b2884cf44e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 4ffccc9e-10cc-413f-ac60-518d6541968a] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:41:57.570575 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-79e264a6-616b-4ccd-881b-62b2884cf44e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:57.571022 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-79e264a6-616b-4ccd-881b-62b2884cf44e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:57.571809 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-79e264a6-616b-4ccd-881b-62b2884cf44e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:57.572245 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-79e264a6-616b-4ccd-881b-62b2884cf44e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:57.601603 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-79e264a6-616b-4ccd-881b-62b2884cf44e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/4ffccc9e-10cc-413f-ac60-518d6541968a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043267 Jul 15 20:41:57.602150 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 335/668] 10.222.0.66 () {58 vars in 1301 bytes} [Fri Jul 15 20:41:57 2022] GET /compute/v2.1/servers/4ffccc9e-10cc-413f-ac60-518d6541968a/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 15 20:41:57.658266 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-7c927b29-271f-4ee5-8081-de679556d07e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:41:57.658787 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-7c927b29-271f-4ee5-8081-de679556d07e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 4ffccc9e-10cc-413f-ac60-518d6541968a] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:41:57.665329 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7c927b29-271f-4ee5-8081-de679556d07e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:57.666037 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7c927b29-271f-4ee5-8081-de679556d07e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:57.666823 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7c927b29-271f-4ee5-8081-de679556d07e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:57.667260 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7c927b29-271f-4ee5-8081-de679556d07e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:57.693085 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-7c927b29-271f-4ee5-8081-de679556d07e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 4ffccc9e-10cc-413f-ac60-518d6541968a] Going to try to terminate instance {{(pid=124432) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 20:41:57.767941 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-7c927b29-271f-4ee5-8081-de679556d07e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "DELETE /compute/v2.1/servers/4ffccc9e-10cc-413f-ac60-518d6541968a" status: 204 len: 0 microversion: 2.1 time: 0.113962 Jul 15 20:41:57.768756 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 334/669] 10.222.0.66 () {58 vars in 1238 bytes} [Fri Jul 15 20:41:57 2022] DELETE /compute/v2.1/servers/4ffccc9e-10cc-413f-ac60-518d6541968a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 20:41:57.777408 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-17d289ab-f494-4cd6-8c55-2b01af0fc497 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:41:57.778132 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-17d289ab-f494-4cd6-8c55-2b01af0fc497 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 4ffccc9e-10cc-413f-ac60-518d6541968a] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:41:57.784849 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-17d289ab-f494-4cd6-8c55-2b01af0fc497 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:57.785298 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-17d289ab-f494-4cd6-8c55-2b01af0fc497 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:57.786054 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-17d289ab-f494-4cd6-8c55-2b01af0fc497 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:57.786487 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-17d289ab-f494-4cd6-8c55-2b01af0fc497 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:57.916231 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-17d289ab-f494-4cd6-8c55-2b01af0fc497 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:41:57.923709 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-17d289ab-f494-4cd6-8c55-2b01af0fc497 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/4ffccc9e-10cc-413f-ac60-518d6541968a" status: 200 len: 1682 microversion: 2.1 time: 0.150286 Jul 15 20:41:57.924277 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 336/670] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:41:57 2022] GET /compute/v2.1/servers/4ffccc9e-10cc-413f-ac60-518d6541968a => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:41:58.940619 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-becaade9-9896-4e7e-a053-faacb4baa45e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:41:58.941308 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-becaade9-9896-4e7e-a053-faacb4baa45e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 4ffccc9e-10cc-413f-ac60-518d6541968a] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:41:58.947841 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-becaade9-9896-4e7e-a053-faacb4baa45e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:58.948287 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-becaade9-9896-4e7e-a053-faacb4baa45e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:58.949071 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-becaade9-9896-4e7e-a053-faacb4baa45e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:41:58.949503 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-becaade9-9896-4e7e-a053-faacb4baa45e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:41:59.082270 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-becaade9-9896-4e7e-a053-faacb4baa45e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:41:59.093594 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-becaade9-9896-4e7e-a053-faacb4baa45e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/4ffccc9e-10cc-413f-ac60-518d6541968a" status: 200 len: 1682 microversion: 2.1 time: 0.157073 Jul 15 20:41:59.094258 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 335/671] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:41:58 2022] GET /compute/v2.1/servers/4ffccc9e-10cc-413f-ac60-518d6541968a => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:42:00.111483 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-523eb4d1-478c-4507-98b8-10e3bd8e806e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:00.112085 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-523eb4d1-478c-4507-98b8-10e3bd8e806e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 4ffccc9e-10cc-413f-ac60-518d6541968a] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:00.118771 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-523eb4d1-478c-4507-98b8-10e3bd8e806e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:00.119213 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-523eb4d1-478c-4507-98b8-10e3bd8e806e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:00.119966 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-523eb4d1-478c-4507-98b8-10e3bd8e806e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:00.120418 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-523eb4d1-478c-4507-98b8-10e3bd8e806e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:00.182603 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-523eb4d1-478c-4507-98b8-10e3bd8e806e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:42:00.190600 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-523eb4d1-478c-4507-98b8-10e3bd8e806e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/4ffccc9e-10cc-413f-ac60-518d6541968a" status: 200 len: 1614 microversion: 2.1 time: 0.082988 Jul 15 20:42:00.191188 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 337/672] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:42:00 2022] GET /compute/v2.1/servers/4ffccc9e-10cc-413f-ac60-518d6541968a => generated 1614 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:42:00.346799 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-4d5c1462-3b36-4eae-9b08-7a551e5825db req-e7576cc6-2e0d-46c1-ac4f-e0b52067e338 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ffccc9e-10cc-413f-ac60-518d6541968a", "name": "network-vif-deleted", "tag": "e830d7aa-cb37-4cb9-98b3-6e2ce9280079"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:42:00.356103 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-4d5c1462-3b36-4eae-9b08-7a551e5825db req-e7576cc6-2e0d-46c1-ac4f-e0b52067e338 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:00.356651 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-4d5c1462-3b36-4eae-9b08-7a551e5825db req-e7576cc6-2e0d-46c1-ac4f-e0b52067e338 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:00.369229 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-4d5c1462-3b36-4eae-9b08-7a551e5825db req-e7576cc6-2e0d-46c1-ac4f-e0b52067e338 service nova] Creating event network-vif-deleted:e830d7aa-cb37-4cb9-98b3-6e2ce9280079 for instance 4ffccc9e-10cc-413f-ac60-518d6541968a on hv-cinder-79987 Jul 15 20:42:00.374531 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-4d5c1462-3b36-4eae-9b08-7a551e5825db req-e7576cc6-2e0d-46c1-ac4f-e0b52067e338 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031854 Jul 15 20:42:00.375188 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 336/673] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:42:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:42:01.208022 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-969ab176-6e32-4cbd-b0d5-0f1a3913f06b tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:01.208654 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-969ab176-6e32-4cbd-b0d5-0f1a3913f06b tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 4ffccc9e-10cc-413f-ac60-518d6541968a] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:01.215245 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-969ab176-6e32-4cbd-b0d5-0f1a3913f06b tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:01.215692 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-969ab176-6e32-4cbd-b0d5-0f1a3913f06b tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:01.217023 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-969ab176-6e32-4cbd-b0d5-0f1a3913f06b tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:01.217536 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-969ab176-6e32-4cbd-b0d5-0f1a3913f06b tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:01.231104 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.wsgi [None req-969ab176-6e32-4cbd-b0d5-0f1a3913f06b tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] HTTP exception thrown: Instance 4ffccc9e-10cc-413f-ac60-518d6541968a could not be found. Jul 15 20:42:01.233553 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-969ab176-6e32-4cbd-b0d5-0f1a3913f06b tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Request method failure captured: Jul 15 20:42:01.233553 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: request: GET /compute/v2.1/servers/4ffccc9e-10cc-413f-ac60-518d6541968a HTTP/1.1 Jul 15 20:42:01.233553 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Accept: application/json Jul 15 20:42:01.233553 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Accept-Encoding: identity Jul 15 20:42:01.233553 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Connection: close Jul 15 20:42:01.233553 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Content-Length: 0 Jul 15 20:42:01.233553 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Content-Type: application/json Jul 15 20:42:01.233553 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Host: 10.222.0.66 Jul 15 20:42:01.233553 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Openstack-System-Scope: None Jul 15 20:42:01.233553 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: User-Agent: python-urllib3/1.26.9 Jul 15 20:42:01.233553 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Auth-Token: gAAAAABi0c_kH9ys3aP35h1LWWw3r1ieyA8CI0v0WIPPxjHmBB6aGubC4LmfLrm23mJ8HvmdkzR7wDAmSNK2w9OIr-gnn6Blv4WbaRzcu_QA8HGYGiqbz987b1vb5xUWoBYf2fTfD1m5oPgbP0g7S9YRfksUIFxkz4MW4lkoTMD9FFmUr-jPyfM Jul 15 20:42:01.233553 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Domain-Id: None Jul 15 20:42:01.233553 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Domain-Name: None Jul 15 20:42:01.233553 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Identity-Status: Confirmed Jul 15 20:42:01.233553 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Is-Admin-Project: True Jul 15 20:42:01.233553 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Domain-Id: default Jul 15 20:42:01.233553 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Domain-Name: Default Jul 15 20:42:01.233553 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Id: 78a593e163e74a7b9db61133e5c22035 Jul 15 20:42:01.233553 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Name: tempest-AttachVolumeNegativeTest-846080947 Jul 15 20:42:01.233553 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Role: member,reader Jul 15 20:42:01.233553 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Roles: member,reader Jul 15 20:42:01.234978 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/78a593e163e74a7b9db61133e5c22035"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_78a593e163e74a7b9db61133e5c22035"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/78a593e163e74a7b9db61133e5c22035"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/78a593e163e74a7b9db61133e5c22035"}]}] Jul 15 20:42:01.234978 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant: tempest-AttachVolumeNegativeTest-846080947 Jul 15 20:42:01.234978 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant-Id: 78a593e163e74a7b9db61133e5c22035 Jul 15 20:42:01.234978 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-846080947 Jul 15 20:42:01.234978 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User: tempest-AttachVolumeNegativeTest-846080947-project Jul 15 20:42:01.234978 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Domain-Id: default Jul 15 20:42:01.234978 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Domain-Name: Default Jul 15 20:42:01.234978 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Id: c0b5962b37b2470099436609425f7423 Jul 15 20:42:01.234978 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Name: tempest-AttachVolumeNegativeTest-846080947-project Jul 15 20:42:01.234978 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: method: > Jul 15 20:42:01.234978 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: exception: Instance 4ffccc9e-10cc-413f-ac60-518d6541968a could not be found. Jul 15 20:42:01.234978 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: action_args: {'id': '4ffccc9e-10cc-413f-ac60-518d6541968a'} Jul 15 20:42:01.236160 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 20:42:01.236160 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:42:01.236160 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 20:42:01.236160 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 20:42:01.236160 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 20:42:01.236160 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 20:42:01.236160 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 20:42:01.236160 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 20:42:01.236160 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 20:42:01.236160 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 20:42:01.236160 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ffccc9e-10cc-413f-ac60-518d6541968a could not be found. Jul 15 20:42:01.236160 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:42:01.236160 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:42:01.236160 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:42:01.236160 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:42:01.236160 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:42:01.236160 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:42:01.236160 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 20:42:01.236160 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 20:42:01.236160 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 20:42:01.237743 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 20:42:01.237743 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 20:42:01.237743 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 20:42:01.237743 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 20:42:01.237743 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 20:42:01.237743 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 20:42:01.237743 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 20:42:01.237743 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ffccc9e-10cc-413f-ac60-518d6541968a could not be found. Jul 15 20:42:01.237743 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:42:01.237743 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:42:01.237743 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:42:01.237743 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:42:01.237743 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:42:01.237743 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:42:01.237743 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 20:42:01.237743 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 20:42:01.237743 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ffccc9e-10cc-413f-ac60-518d6541968a could not be found. Jul 15 20:42:01.237743 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:42:01.239230 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-969ab176-6e32-4cbd-b0d5-0f1a3913f06b tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Returning 404 to user: Instance 4ffccc9e-10cc-413f-ac60-518d6541968a could not be found. {{(pid=124430) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 20:42:01.239230 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-969ab176-6e32-4cbd-b0d5-0f1a3913f06b tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/4ffccc9e-10cc-413f-ac60-518d6541968a" status: 404 len: 111 microversion: 2.1 time: 0.030765 Jul 15 20:42:01.239230 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 338/674] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:42:01 2022] GET /compute/v2.1/servers/4ffccc9e-10cc-413f-ac60-518d6541968a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 20:42:01.245036 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-1d1a7fbb-c777-4e81-9299-161dad86c7d5 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '.version_select at 0x7ff5183b73a0>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:01.262862 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-1d1a7fbb-c777-4e81-9299-161dad86c7d5 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-863849489" status: 202 len: 0 microversion: 2.1 time: 0.021956 Jul 15 20:42:01.267158 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 337/675] 10.222.0.66 () {58 vars in 1217 bytes} [Fri Jul 15 20:42:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-863849489 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 20:42:01.874442 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-658b85c9-4461-45e9-bc32-31a9f1abfb82 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Action: 'create', calling method: .version_select at 0x7ff518397700>, body: {"keypair": {"name": "tempest-keypair-503783592", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbXc7jIlu4oRVaXHISM+gTFsDzddnEfRKtmBgizphfq0PMdps1DDcL2y7mf/bEgBJf+kuTUplxwjb237dbi5CYjSCjqHAiSNYhsPwNHrXxL8Ru9SD+qCcYnCLuxdEodgw=="}} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:42:01.889570 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.quota [None req-658b85c9-4461-45e9-bc32-31a9f1abfb82 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Getting quotas for project 78a593e163e74a7b9db61133e5c22035. Resources: {'key_pairs'} {{(pid=124430) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 20:42:01.893524 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.quota [None req-658b85c9-4461-45e9-bc32-31a9f1abfb82 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Getting quotas for user c0b5962b37b2470099436609425f7423 and project 78a593e163e74a7b9db61133e5c22035. Resources: {'key_pairs'} {{(pid=124430) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 20:42:01.914228 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-658b85c9-4461-45e9-bc32-31a9f1abfb82 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044412 Jul 15 20:42:01.914797 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 339/676] 10.222.0.66 () {60 vars in 1158 bytes} [Fri Jul 15 20:42:01 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:42:03.123245 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-6c5bc796-f94a-434b-931d-596794edde64 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1417240401", "imageRef": "a759604a-67e3-4c79-b848-5d03d936d7a0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f64ae9a9-bcaf-4115-89a7-71a9ec023719"}], "security_groups": [{"name": "tempest-securitygroup--256256943"}], "key_name": "tempest-keypair-503783592", "user_data": "}} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:42:03.223086 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.network.neutron [None req-6c5bc796-f94a-434b-931d-596794edde64 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] validate_networks() for [('f64ae9a9-bcaf-4115-89a7-71a9ec023719', None, None, None, None, None)] {{(pid=124432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 20:42:03.853753 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-6c5bc796-f94a-434b-931d-596794edde64 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Flavor limits 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 20:42:03.854177 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-6c5bc796-f94a-434b-931d-596794edde64 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Image limits 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 20:42:03.854646 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-6c5bc796-f94a-434b-931d-596794edde64 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Flavor pref 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 20:42:03.855049 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-6c5bc796-f94a-434b-931d-596794edde64 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Image pref 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 20:42:03.855563 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-6c5bc796-f94a-434b-931d-596794edde64 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 20:42:03.864566 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6c5bc796-f94a-434b-931d-596794edde64 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:03.865009 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6c5bc796-f94a-434b-931d-596794edde64 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:03.865800 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6c5bc796-f94a-434b-931d-596794edde64 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:03.866230 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6c5bc796-f94a-434b-931d-596794edde64 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:03.882455 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-6c5bc796-f94a-434b-931d-596794edde64 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Getting quotas for project 78a593e163e74a7b9db61133e5c22035. Resources: {'instances', 'ram', 'cores'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 20:42:03.886364 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-6c5bc796-f94a-434b-931d-596794edde64 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Getting quotas for user c0b5962b37b2470099436609425f7423 and project 78a593e163e74a7b9db61133e5c22035. Resources: {'instances', 'ram', 'cores'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 20:42:03.897937 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-6c5bc796-f94a-434b-931d-596794edde64 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Going to run 1 instances... {{(pid=124432) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 20:42:03.900358 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-6c5bc796-f94a-434b-931d-596794edde64 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 03bcc792-0b91-4282-a495-d8420a3602fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a759604a-67e3-4c79-b848-5d03d936d7a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 20:42:03.946526 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-6c5bc796-f94a-434b-931d-596794edde64 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.827800 Jul 15 20:42:03.947543 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 338/677] 10.222.0.66 () {60 vars in 1146 bytes} [Fri Jul 15 20:42:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 829 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 20:42:03.957710 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-fa9c851d-92cf-47c9-b34b-4e1173ff715b tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:03.958306 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-fa9c851d-92cf-47c9-b34b-4e1173ff715b tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 03bcc792-0b91-4282-a495-d8420a3602fc] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:04.013642 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-fa9c851d-92cf-47c9-b34b-4e1173ff715b tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:42:04.020718 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-fa9c851d-92cf-47c9-b34b-4e1173ff715b tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/03bcc792-0b91-4282-a495-d8420a3602fc" status: 200 len: 1241 microversion: 2.1 time: 0.067236 Jul 15 20:42:04.021283 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 340/678] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:42:03 2022] GET /compute/v2.1/servers/03bcc792-0b91-4282-a495-d8420a3602fc => generated 1241 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:42:05.039104 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-80fb9d87-1c56-49b5-9cb9-d0f09a888054 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:05.040357 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-80fb9d87-1c56-49b5-9cb9-d0f09a888054 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 03bcc792-0b91-4282-a495-d8420a3602fc] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:05.048641 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-80fb9d87-1c56-49b5-9cb9-d0f09a888054 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:05.049088 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-80fb9d87-1c56-49b5-9cb9-d0f09a888054 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:05.049853 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-80fb9d87-1c56-49b5-9cb9-d0f09a888054 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:05.050281 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-80fb9d87-1c56-49b5-9cb9-d0f09a888054 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:05.117103 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-80fb9d87-1c56-49b5-9cb9-d0f09a888054 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:42:05.125528 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-80fb9d87-1c56-49b5-9cb9-d0f09a888054 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/03bcc792-0b91-4282-a495-d8420a3602fc" status: 200 len: 1301 microversion: 2.1 time: 0.090827 Jul 15 20:42:05.126109 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 339/679] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:42:05 2022] GET /compute/v2.1/servers/03bcc792-0b91-4282-a495-d8420a3602fc => generated 1301 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:42:06.143938 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-952d450b-4e79-443c-a223-52f65635e6cc tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:06.144609 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-952d450b-4e79-443c-a223-52f65635e6cc tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 03bcc792-0b91-4282-a495-d8420a3602fc] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:06.151078 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-952d450b-4e79-443c-a223-52f65635e6cc tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:06.151604 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-952d450b-4e79-443c-a223-52f65635e6cc tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:06.152424 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-952d450b-4e79-443c-a223-52f65635e6cc tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:06.152868 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-952d450b-4e79-443c-a223-52f65635e6cc tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:06.289093 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-952d450b-4e79-443c-a223-52f65635e6cc tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:42:06.304664 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-952d450b-4e79-443c-a223-52f65635e6cc tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/03bcc792-0b91-4282-a495-d8420a3602fc" status: 200 len: 1366 microversion: 2.1 time: 0.164902 Jul 15 20:42:06.305270 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 341/680] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:42:06 2022] GET /compute/v2.1/servers/03bcc792-0b91-4282-a495-d8420a3602fc => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:42:06.527888 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-c322f8b2-7308-4a8f-a849-dd2c2a6d839b req-ebad2314-a05f-4668-8c8b-ee9ef50dc56e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03bcc792-0b91-4282-a495-d8420a3602fc", "tag": "997ebb45-8116-4a67-8134-9843c9d6226d"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:42:06.534502 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:42:06.543940 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-c322f8b2-7308-4a8f-a849-dd2c2a6d839b req-ebad2314-a05f-4668-8c8b-ee9ef50dc56e service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:06.544385 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-c322f8b2-7308-4a8f-a849-dd2c2a6d839b req-ebad2314-a05f-4668-8c8b-ee9ef50dc56e service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:06.558844 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:42:06.582995 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-c322f8b2-7308-4a8f-a849-dd2c2a6d839b req-ebad2314-a05f-4668-8c8b-ee9ef50dc56e service nova] Creating event network-changed:997ebb45-8116-4a67-8134-9843c9d6226d for instance 03bcc792-0b91-4282-a495-d8420a3602fc on hv-cinder-79987 Jul 15 20:42:06.588595 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-c322f8b2-7308-4a8f-a849-dd2c2a6d839b req-ebad2314-a05f-4668-8c8b-ee9ef50dc56e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064502 Jul 15 20:42:06.589208 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 340/681] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:42:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 20:42:07.321518 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-bdeabc5e-9352-4eb1-a8d3-bca6a28fe92e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:07.322179 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-bdeabc5e-9352-4eb1-a8d3-bca6a28fe92e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 03bcc792-0b91-4282-a495-d8420a3602fc] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:07.329184 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-bdeabc5e-9352-4eb1-a8d3-bca6a28fe92e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:07.329624 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-bdeabc5e-9352-4eb1-a8d3-bca6a28fe92e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:07.330372 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-bdeabc5e-9352-4eb1-a8d3-bca6a28fe92e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:07.330795 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-bdeabc5e-9352-4eb1-a8d3-bca6a28fe92e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:07.458882 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-bdeabc5e-9352-4eb1-a8d3-bca6a28fe92e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:42:07.467600 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-bdeabc5e-9352-4eb1-a8d3-bca6a28fe92e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/03bcc792-0b91-4282-a495-d8420a3602fc" status: 200 len: 1366 microversion: 2.1 time: 0.149024 Jul 15 20:42:07.468329 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 342/682] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:42:07 2022] GET /compute/v2.1/servers/03bcc792-0b91-4282-a495-d8420a3602fc => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:42:08.486497 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-2f6e8b25-7d04-4fd2-a3c5-eab93b5c1e9e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:08.487198 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-2f6e8b25-7d04-4fd2-a3c5-eab93b5c1e9e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 03bcc792-0b91-4282-a495-d8420a3602fc] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:08.495371 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2f6e8b25-7d04-4fd2-a3c5-eab93b5c1e9e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:08.496524 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2f6e8b25-7d04-4fd2-a3c5-eab93b5c1e9e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:08.497302 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2f6e8b25-7d04-4fd2-a3c5-eab93b5c1e9e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:08.497756 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2f6e8b25-7d04-4fd2-a3c5-eab93b5c1e9e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:08.635752 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-2f6e8b25-7d04-4fd2-a3c5-eab93b5c1e9e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:42:08.643544 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-2f6e8b25-7d04-4fd2-a3c5-eab93b5c1e9e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/03bcc792-0b91-4282-a495-d8420a3602fc" status: 200 len: 1366 microversion: 2.1 time: 0.162648 Jul 15 20:42:08.644131 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 341/683] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:42:08 2022] GET /compute/v2.1/servers/03bcc792-0b91-4282-a495-d8420a3602fc => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:42:09.660838 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-49967326-3af4-4544-a61a-385fdde1790f tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:09.661454 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-49967326-3af4-4544-a61a-385fdde1790f tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 03bcc792-0b91-4282-a495-d8420a3602fc] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:09.668287 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-49967326-3af4-4544-a61a-385fdde1790f tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:09.668772 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-49967326-3af4-4544-a61a-385fdde1790f tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:09.669679 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-49967326-3af4-4544-a61a-385fdde1790f tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:09.670194 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-49967326-3af4-4544-a61a-385fdde1790f tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:09.798118 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-49967326-3af4-4544-a61a-385fdde1790f tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:42:09.805384 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-49967326-3af4-4544-a61a-385fdde1790f tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/03bcc792-0b91-4282-a495-d8420a3602fc" status: 200 len: 1366 microversion: 2.1 time: 0.148407 Jul 15 20:42:09.805940 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 343/684] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:42:09 2022] GET /compute/v2.1/servers/03bcc792-0b91-4282-a495-d8420a3602fc => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:42:10.177619 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-163c5b11-42cc-49ce-a85c-e5506a50cdf4 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-754581922"}} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:42:10.178191 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-163c5b11-42cc-49ce-a85c-e5506a50cdf4 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] [instance: 67ed2b36-9422-4f98-8a39-83c214eadae9] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:10.184640 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-163c5b11-42cc-49ce-a85c-e5506a50cdf4 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:10.186008 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-163c5b11-42cc-49ce-a85c-e5506a50cdf4 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:10.186980 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-163c5b11-42cc-49ce-a85c-e5506a50cdf4 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:10.187418 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-163c5b11-42cc-49ce-a85c-e5506a50cdf4 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:10.319144 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.network.security_group_api [None req-163c5b11-42cc-49ce-a85c-e5506a50cdf4 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Removing security group b1b8b8cf-53aa-45af-b149-b9442acb5e5b from port 138653ff-cbaa-43a2-9358-b327bc394857 Jul 15 20:42:10.672080 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-163c5b11-42cc-49ce-a85c-e5506a50cdf4 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] 10.222.0.66 "POST /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9/action" status: 202 len: 0 microversion: 2.1 time: 0.498349 Jul 15 20:42:10.673409 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 342/685] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 15 20:42:10 2022] POST /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9/action => generated 0 bytes in 501 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 20:42:10.690069 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [req-34cdfbc6-0ca6-4bf4-9a27-df0e6b314c62 req-9633129e-a794-4032-8513-4397c73b7331 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67ed2b36-9422-4f98-8a39-83c214eadae9", "tag": "138653ff-cbaa-43a2-9358-b327bc394857"}]} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:42:10.700072 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-34cdfbc6-0ca6-4bf4-9a27-df0e6b314c62 req-9633129e-a794-4032-8513-4397c73b7331 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:10.700765 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-34cdfbc6-0ca6-4bf4-9a27-df0e6b314c62 req-9633129e-a794-4032-8513-4397c73b7331 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:10.714611 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.compute.server_external_events [req-34cdfbc6-0ca6-4bf4-9a27-df0e6b314c62 req-9633129e-a794-4032-8513-4397c73b7331 service nova] Creating event network-changed:138653ff-cbaa-43a2-9358-b327bc394857 for instance 67ed2b36-9422-4f98-8a39-83c214eadae9 on hv-cinder-79987 Jul 15 20:42:10.721454 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [req-34cdfbc6-0ca6-4bf4-9a27-df0e6b314c62 req-9633129e-a794-4032-8513-4397c73b7331 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035272 Jul 15 20:42:10.722358 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 344/686] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:42:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:42:10.822178 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-03c82526-25e8-49b2-a89c-1a07c5717a87 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:10.823078 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-03c82526-25e8-49b2-a89c-1a07c5717a87 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 03bcc792-0b91-4282-a495-d8420a3602fc] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:10.829858 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-03c82526-25e8-49b2-a89c-1a07c5717a87 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:10.830310 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-03c82526-25e8-49b2-a89c-1a07c5717a87 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:10.831089 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-03c82526-25e8-49b2-a89c-1a07c5717a87 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:10.831523 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-03c82526-25e8-49b2-a89c-1a07c5717a87 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:11.018709 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-03c82526-25e8-49b2-a89c-1a07c5717a87 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:42:11.037730 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-03c82526-25e8-49b2-a89c-1a07c5717a87 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/03bcc792-0b91-4282-a495-d8420a3602fc" status: 200 len: 1366 microversion: 2.1 time: 0.219279 Jul 15 20:42:11.038328 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 343/687] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:42:10 2022] GET /compute/v2.1/servers/03bcc792-0b91-4282-a495-d8420a3602fc => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:42:11.829054 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-b3b63584-78ab-4bcd-8081-3f7d8dc8af1b tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:11.829734 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-b3b63584-78ab-4bcd-8081-3f7d8dc8af1b tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 943a9a49-4fcd-46a5-b444-1a94f490ae2e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:11.837363 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b3b63584-78ab-4bcd-8081-3f7d8dc8af1b tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:11.838493 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b3b63584-78ab-4bcd-8081-3f7d8dc8af1b tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:11.839346 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b3b63584-78ab-4bcd-8081-3f7d8dc8af1b tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:11.839866 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b3b63584-78ab-4bcd-8081-3f7d8dc8af1b tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:11.841838 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-aa3b9697-4fff-4c4e-9dc4-b023c3517310 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:11.842394 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-aa3b9697-4fff-4c4e-9dc4-b023c3517310 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] [instance: 67ed2b36-9422-4f98-8a39-83c214eadae9] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:11.849117 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-aa3b9697-4fff-4c4e-9dc4-b023c3517310 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:11.849556 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-aa3b9697-4fff-4c4e-9dc4-b023c3517310 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:11.850313 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-aa3b9697-4fff-4c4e-9dc4-b023c3517310 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:11.850735 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-aa3b9697-4fff-4c4e-9dc4-b023c3517310 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:11.931588 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.objects.instance [None req-b3b63584-78ab-4bcd-8081-3f7d8dc8af1b tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lazy-loading 'services' on Instance uuid 943a9a49-4fcd-46a5-b444-1a94f490ae2e {{(pid=124430) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 20:42:11.938545 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.objects.instance [None req-aa3b9697-4fff-4c4e-9dc4-b023c3517310 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lazy-loading 'services' on Instance uuid 67ed2b36-9422-4f98-8a39-83c214eadae9 {{(pid=124432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 20:42:12.017339 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-aa3b9697-4fff-4c4e-9dc4-b023c3517310 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] 10.222.0.66 "DELETE /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9/os-volume_attachments/d53b1f18-ab46-491c-8e05-f492a7fdb298" status: 202 len: 0 microversion: 2.1 time: 0.179314 Jul 15 20:42:12.021732 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-b3b63584-78ab-4bcd-8081-3f7d8dc8af1b tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "DELETE /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e/os-volume_attachments/5c5590bb-68e6-4803-8751-f4e5c10fae38" status: 202 len: 0 microversion: 2.1 time: 0.197413 Jul 15 20:42:12.021927 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 344/688] 10.222.0.66 () {58 vars in 1415 bytes} [Fri Jul 15 20:42:11 2022] DELETE /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9/os-volume_attachments/d53b1f18-ab46-491c-8e05-f492a7fdb298 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 15 20:42:12.024184 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 345/689] 10.222.0.66 () {58 vars in 1415 bytes} [Fri Jul 15 20:42:11 2022] DELETE /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e/os-volume_attachments/5c5590bb-68e6-4803-8751-f4e5c10fae38 => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 20:42:12.033943 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-44636da2-4877-41d4-8ec1-50ff9c0b842a tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:12.035989 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-44636da2-4877-41d4-8ec1-50ff9c0b842a tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 943a9a49-4fcd-46a5-b444-1a94f490ae2e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:12.046824 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-c2bb5036-f953-40a1-a981-a9db53f40868 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:12.049533 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-44636da2-4877-41d4-8ec1-50ff9c0b842a tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:12.050295 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-44636da2-4877-41d4-8ec1-50ff9c0b842a tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:12.050625 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-c2bb5036-f953-40a1-a981-a9db53f40868 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] [instance: 67ed2b36-9422-4f98-8a39-83c214eadae9] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:12.051766 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-44636da2-4877-41d4-8ec1-50ff9c0b842a tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:12.053144 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-44636da2-4877-41d4-8ec1-50ff9c0b842a tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:12.069306 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c2bb5036-f953-40a1-a981-a9db53f40868 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:12.070445 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c2bb5036-f953-40a1-a981-a9db53f40868 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:12.072631 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c2bb5036-f953-40a1-a981-a9db53f40868 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:12.073361 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c2bb5036-f953-40a1-a981-a9db53f40868 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:12.092904 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-44636da2-4877-41d4-8ec1-50ff9c0b842a tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064145 Jul 15 20:42:12.093771 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 346/690] 10.222.0.66 () {58 vars in 1301 bytes} [Fri Jul 15 20:42:12 2022] GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:42:12.101225 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-0c45e891-576c-452c-908c-cf98e8a7865e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:12.104656 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-0c45e891-576c-452c-908c-cf98e8a7865e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 03bcc792-0b91-4282-a495-d8420a3602fc] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:12.113333 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-0c45e891-576c-452c-908c-cf98e8a7865e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:12.113985 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-0c45e891-576c-452c-908c-cf98e8a7865e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:12.114973 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-0c45e891-576c-452c-908c-cf98e8a7865e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:12.115600 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-0c45e891-576c-452c-908c-cf98e8a7865e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:12.117701 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-c2bb5036-f953-40a1-a981-a9db53f40868 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] 10.222.0.66 "GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094246 Jul 15 20:42:12.118343 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 345/691] 10.222.0.66 () {58 vars in 1301 bytes} [Fri Jul 15 20:42:12 2022] GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:42:12.207711 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-c5e7e6e0-a714-42ec-b579-c566616b21c1 req-f53500f1-8fbf-4e4e-9e71-f1210103db5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03bcc792-0b91-4282-a495-d8420a3602fc", "name": "network-vif-plugged", "status": "completed", "tag": "997ebb45-8116-4a67-8134-9843c9d6226d"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:42:12.219394 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-c5e7e6e0-a714-42ec-b579-c566616b21c1 req-f53500f1-8fbf-4e4e-9e71-f1210103db5a service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:12.222429 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-c5e7e6e0-a714-42ec-b579-c566616b21c1 req-f53500f1-8fbf-4e4e-9e71-f1210103db5a service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:12.243961 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-c5e7e6e0-a714-42ec-b579-c566616b21c1 req-f53500f1-8fbf-4e4e-9e71-f1210103db5a service nova] Creating event network-vif-plugged:997ebb45-8116-4a67-8134-9843c9d6226d for instance 03bcc792-0b91-4282-a495-d8420a3602fc on hv-cinder-79987 Jul 15 20:42:12.250654 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-c5e7e6e0-a714-42ec-b579-c566616b21c1 req-f53500f1-8fbf-4e4e-9e71-f1210103db5a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046379 Jul 15 20:42:12.256492 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 346/692] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:42:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 20:42:12.292334 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-0c45e891-576c-452c-908c-cf98e8a7865e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:42:12.299778 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-0c45e891-576c-452c-908c-cf98e8a7865e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/03bcc792-0b91-4282-a495-d8420a3602fc" status: 200 len: 1366 microversion: 2.1 time: 0.204801 Jul 15 20:42:12.300340 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 347/693] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:42:12 2022] GET /compute/v2.1/servers/03bcc792-0b91-4282-a495-d8420a3602fc => generated 1366 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:42:12.743707 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-925ddc4e-5f3b-44e1-a6a2-1ce8ba30b026 req-c7f7acfe-3497-4c4f-96ef-4653c3ff9088 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67ed2b36-9422-4f98-8a39-83c214eadae9", "tag": "138653ff-cbaa-43a2-9358-b327bc394857"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:42:12.758368 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-925ddc4e-5f3b-44e1-a6a2-1ce8ba30b026 req-c7f7acfe-3497-4c4f-96ef-4653c3ff9088 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:12.758806 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-925ddc4e-5f3b-44e1-a6a2-1ce8ba30b026 req-c7f7acfe-3497-4c4f-96ef-4653c3ff9088 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:12.770721 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-925ddc4e-5f3b-44e1-a6a2-1ce8ba30b026 req-c7f7acfe-3497-4c4f-96ef-4653c3ff9088 service nova] Creating event network-changed:138653ff-cbaa-43a2-9358-b327bc394857 for instance 67ed2b36-9422-4f98-8a39-83c214eadae9 on hv-cinder-79987 Jul 15 20:42:12.776200 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-925ddc4e-5f3b-44e1-a6a2-1ce8ba30b026 req-c7f7acfe-3497-4c4f-96ef-4653c3ff9088 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036411 Jul 15 20:42:12.776842 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 347/694] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:42:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:42:13.103983 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-3da8da4f-f0e3-4b80-974b-d7af4d71e56f tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:13.104921 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-3da8da4f-f0e3-4b80-974b-d7af4d71e56f tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 943a9a49-4fcd-46a5-b444-1a94f490ae2e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:13.111699 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-3da8da4f-f0e3-4b80-974b-d7af4d71e56f tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:13.112143 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-3da8da4f-f0e3-4b80-974b-d7af4d71e56f tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:13.112971 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-3da8da4f-f0e3-4b80-974b-d7af4d71e56f tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:13.113402 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-3da8da4f-f0e3-4b80-974b-d7af4d71e56f tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:13.131329 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-e0519732-51e2-4b2a-a6e7-f0c5ebf84039 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:13.132985 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-e0519732-51e2-4b2a-a6e7-f0c5ebf84039 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] [instance: 67ed2b36-9422-4f98-8a39-83c214eadae9] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:13.139922 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e0519732-51e2-4b2a-a6e7-f0c5ebf84039 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:13.140372 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e0519732-51e2-4b2a-a6e7-f0c5ebf84039 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:13.141168 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e0519732-51e2-4b2a-a6e7-f0c5ebf84039 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:13.141604 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e0519732-51e2-4b2a-a6e7-f0c5ebf84039 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:13.145713 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-3da8da4f-f0e3-4b80-974b-d7af4d71e56f tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045599 Jul 15 20:42:13.146266 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 348/695] 10.222.0.66 () {58 vars in 1301 bytes} [Fri Jul 15 20:42:13 2022] GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:42:13.169998 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-e0519732-51e2-4b2a-a6e7-f0c5ebf84039 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] 10.222.0.66 "GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043456 Jul 15 20:42:13.170556 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 348/696] 10.222.0.66 () {58 vars in 1301 bytes} [Fri Jul 15 20:42:13 2022] GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:42:13.317209 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-21314725-0a94-4e2f-9372-46c73354cdee tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:13.317711 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-21314725-0a94-4e2f-9372-46c73354cdee tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 03bcc792-0b91-4282-a495-d8420a3602fc] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:13.323685 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-21314725-0a94-4e2f-9372-46c73354cdee tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:13.324123 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-21314725-0a94-4e2f-9372-46c73354cdee tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:13.324894 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-21314725-0a94-4e2f-9372-46c73354cdee tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:13.325319 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-21314725-0a94-4e2f-9372-46c73354cdee tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:13.462366 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-21314725-0a94-4e2f-9372-46c73354cdee tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:42:13.471171 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-21314725-0a94-4e2f-9372-46c73354cdee tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/03bcc792-0b91-4282-a495-d8420a3602fc" status: 200 len: 1366 microversion: 2.1 time: 0.157830 Jul 15 20:42:13.471943 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 349/697] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:42:13 2022] GET /compute/v2.1/servers/03bcc792-0b91-4282-a495-d8420a3602fc => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:42:14.157217 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-8916a17d-870e-489b-b574-093e57ba0e77 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:14.158117 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-8916a17d-870e-489b-b574-093e57ba0e77 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 943a9a49-4fcd-46a5-b444-1a94f490ae2e] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:14.160060 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell0:SELECT=2 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:42:14.160849 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell0:SELECT=6 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:42:14.166983 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8916a17d-870e-489b-b574-093e57ba0e77 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:14.167422 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8916a17d-870e-489b-b574-093e57ba0e77 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:14.168195 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8916a17d-870e-489b-b574-093e57ba0e77 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:14.168650 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8916a17d-870e-489b-b574-093e57ba0e77 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:14.181846 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-ef4b002a-a974-4c2c-9051-3b547852111b tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:14.183217 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-ef4b002a-a974-4c2c-9051-3b547852111b tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] [instance: 67ed2b36-9422-4f98-8a39-83c214eadae9] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:14.186491 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_cell0:SELECT=6 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:42:14.190938 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-ef4b002a-a974-4c2c-9051-3b547852111b tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:14.191386 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-ef4b002a-a974-4c2c-9051-3b547852111b tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:14.192154 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-ef4b002a-a974-4c2c-9051-3b547852111b tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:14.192691 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-ef4b002a-a974-4c2c-9051-3b547852111b tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:14.198406 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-8916a17d-870e-489b-b574-093e57ba0e77 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045126 Jul 15 20:42:14.199169 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 349/698] 10.222.0.66 () {58 vars in 1301 bytes} [Fri Jul 15 20:42:14 2022] GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 15 20:42:14.222872 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-ef4b002a-a974-4c2c-9051-3b547852111b tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] 10.222.0.66 "GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044954 Jul 15 20:42:14.223434 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 350/699] 10.222.0.66 () {58 vars in 1301 bytes} [Fri Jul 15 20:42:14 2022] GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 20:42:14.273663 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-72d45f5c-b4da-4668-a2c1-c59e502b2b5f tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:14.274208 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-72d45f5c-b4da-4668-a2c1-c59e502b2b5f tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 943a9a49-4fcd-46a5-b444-1a94f490ae2e] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:14.281533 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-72d45f5c-b4da-4668-a2c1-c59e502b2b5f tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:14.281979 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-72d45f5c-b4da-4668-a2c1-c59e502b2b5f tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:14.282738 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-72d45f5c-b4da-4668-a2c1-c59e502b2b5f tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:14.283170 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-72d45f5c-b4da-4668-a2c1-c59e502b2b5f tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:14.307883 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-72d45f5c-b4da-4668-a2c1-c59e502b2b5f tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 943a9a49-4fcd-46a5-b444-1a94f490ae2e] Going to try to terminate instance {{(pid=124432) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 20:42:14.380175 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-72d45f5c-b4da-4668-a2c1-c59e502b2b5f tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "DELETE /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e" status: 204 len: 0 microversion: 2.1 time: 0.110626 Jul 15 20:42:14.380827 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 350/700] 10.222.0.66 () {58 vars in 1238 bytes} [Fri Jul 15 20:42:14 2022] DELETE /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 20:42:14.389319 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-fc83104e-ee45-40d8-9f80-c3100e9e60a4 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:14.389963 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-fc83104e-ee45-40d8-9f80-c3100e9e60a4 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 943a9a49-4fcd-46a5-b444-1a94f490ae2e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:14.395913 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-fc83104e-ee45-40d8-9f80-c3100e9e60a4 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:14.396374 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-fc83104e-ee45-40d8-9f80-c3100e9e60a4 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:14.397270 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-fc83104e-ee45-40d8-9f80-c3100e9e60a4 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:14.397688 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-fc83104e-ee45-40d8-9f80-c3100e9e60a4 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:14.488910 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-b95eb73d-e90e-40ad-8cdb-91dba8b13498 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:14.489596 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-b95eb73d-e90e-40ad-8cdb-91dba8b13498 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 03bcc792-0b91-4282-a495-d8420a3602fc] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:14.495880 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b95eb73d-e90e-40ad-8cdb-91dba8b13498 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:14.496487 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b95eb73d-e90e-40ad-8cdb-91dba8b13498 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:14.498080 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b95eb73d-e90e-40ad-8cdb-91dba8b13498 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:14.499165 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b95eb73d-e90e-40ad-8cdb-91dba8b13498 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:14.557830 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-fc83104e-ee45-40d8-9f80-c3100e9e60a4 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:42:14.566563 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-fc83104e-ee45-40d8-9f80-c3100e9e60a4 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e" status: 200 len: 1691 microversion: 2.1 time: 0.181750 Jul 15 20:42:14.567243 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 351/701] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:42:14 2022] GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e => generated 1691 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:42:14.646530 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-b95eb73d-e90e-40ad-8cdb-91dba8b13498 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:42:14.654254 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-b95eb73d-e90e-40ad-8cdb-91dba8b13498 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/03bcc792-0b91-4282-a495-d8420a3602fc" status: 200 len: 1366 microversion: 2.1 time: 0.169679 Jul 15 20:42:14.654825 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 351/702] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:42:14 2022] GET /compute/v2.1/servers/03bcc792-0b91-4282-a495-d8420a3602fc => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:42:15.234780 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-eec69cc1-2687-4202-8333-4404cbc01f40 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:15.235745 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-eec69cc1-2687-4202-8333-4404cbc01f40 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] [instance: 67ed2b36-9422-4f98-8a39-83c214eadae9] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:15.238038 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=1 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:42:15.243414 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-eec69cc1-2687-4202-8333-4404cbc01f40 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:15.243856 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-eec69cc1-2687-4202-8333-4404cbc01f40 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:15.244637 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-eec69cc1-2687-4202-8333-4404cbc01f40 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:15.245064 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-eec69cc1-2687-4202-8333-4404cbc01f40 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:15.274497 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-eec69cc1-2687-4202-8333-4404cbc01f40 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] 10.222.0.66 "GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043944 Jul 15 20:42:15.275082 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 352/703] 10.222.0.66 () {58 vars in 1301 bytes} [Fri Jul 15 20:42:15 2022] GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 15 20:42:15.284958 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-ddee1cdc-bc88-4795-be5b-527e68de3566 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:15.285457 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-ddee1cdc-bc88-4795-be5b-527e68de3566 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] [instance: 67ed2b36-9422-4f98-8a39-83c214eadae9] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:15.292191 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ddee1cdc-bc88-4795-be5b-527e68de3566 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:15.292668 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ddee1cdc-bc88-4795-be5b-527e68de3566 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:15.293421 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ddee1cdc-bc88-4795-be5b-527e68de3566 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:15.293850 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ddee1cdc-bc88-4795-be5b-527e68de3566 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:15.366680 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.wsgi [None req-ddee1cdc-bc88-4795-be5b-527e68de3566 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] HTTP exception thrown: Instance 67ed2b36-9422-4f98-8a39-83c214eadae9 is not attached to volume d53b1f18-ab46-491c-8e05-f492a7fdb298 Jul 15 20:42:15.369045 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-ddee1cdc-bc88-4795-be5b-527e68de3566 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Request method failure captured: Jul 15 20:42:15.369045 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: request: DELETE /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9/os-volume_attachments/d53b1f18-ab46-491c-8e05-f492a7fdb298 HTTP/1.1 Jul 15 20:42:15.369045 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Accept: application/json Jul 15 20:42:15.369045 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Accept-Encoding: identity Jul 15 20:42:15.369045 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Connection: close Jul 15 20:42:15.369045 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Content-Length: 0 Jul 15 20:42:15.369045 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Content-Type: application/json Jul 15 20:42:15.369045 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Host: 10.222.0.66 Jul 15 20:42:15.369045 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Openstack-System-Scope: None Jul 15 20:42:15.369045 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: User-Agent: python-urllib3/1.26.9 Jul 15 20:42:15.369045 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Auth-Token: gAAAAABi0dCCTx3lkfOMcQToALH4P48Rgk_HGvXqzOkdqT3egFr5eytuibRWoF7N7nBLt7j4mZYe5cF6g6OBO1AuXANA3RyAPbl15lvb0dhUwJfRL0qqC4y08cfEqRrII_Y4pZFkUqhtBO9q69QWpP3VlThuVWefdIui_wGuzNG_8gjuxX7u_E8 Jul 15 20:42:15.369045 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Domain-Id: None Jul 15 20:42:15.369045 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Domain-Name: None Jul 15 20:42:15.369045 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Identity-Status: Confirmed Jul 15 20:42:15.369045 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Is-Admin-Project: True Jul 15 20:42:15.369045 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Domain-Id: default Jul 15 20:42:15.369045 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Domain-Name: Default Jul 15 20:42:15.369045 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Id: 37d62130d6f74b8e919e429cbb3afc55 Jul 15 20:42:15.369045 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Name: tempest-TestMinimumBasicScenario-67481712 Jul 15 20:42:15.369045 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Role: member,reader Jul 15 20:42:15.369045 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Roles: member,reader Jul 15 20:42:15.370566 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/37d62130d6f74b8e919e429cbb3afc55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_37d62130d6f74b8e919e429cbb3afc55"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/37d62130d6f74b8e919e429cbb3afc55"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/37d62130d6f74b8e919e429cbb3afc55"}]}] Jul 15 20:42:15.370566 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Tenant: tempest-TestMinimumBasicScenario-67481712 Jul 15 20:42:15.370566 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Tenant-Id: 37d62130d6f74b8e919e429cbb3afc55 Jul 15 20:42:15.370566 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Tenant-Name: tempest-TestMinimumBasicScenario-67481712 Jul 15 20:42:15.370566 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User: tempest-TestMinimumBasicScenario-67481712-project Jul 15 20:42:15.370566 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Domain-Id: default Jul 15 20:42:15.370566 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Domain-Name: Default Jul 15 20:42:15.370566 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Id: 30a573525d244ab3ab69095db8871f20 Jul 15 20:42:15.370566 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Name: tempest-TestMinimumBasicScenario-67481712-project Jul 15 20:42:15.370566 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: method: > Jul 15 20:42:15.370566 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: exception: Instance 67ed2b36-9422-4f98-8a39-83c214eadae9 is not attached to volume d53b1f18-ab46-491c-8e05-f492a7fdb298 Jul 15 20:42:15.371475 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: action_args: {'server_id': '67ed2b36-9422-4f98-8a39-83c214eadae9', 'id': 'd53b1f18-ab46-491c-8e05-f492a7fdb298'} Jul 15 20:42:15.371475 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 20:42:15.371475 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:42:15.371475 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 15 20:42:15.371475 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 15 20:42:15.371475 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 15 20:42:15.371475 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 15 20:42:15.371475 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 15 20:42:15.371475 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 15 20:42:15.371475 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d53b1f18-ab46-491c-8e05-f492a7fdb298. Jul 15 20:42:15.371475 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:42:15.371475 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:42:15.371475 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:42:15.371475 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:42:15.371475 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:42:15.371475 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:42:15.371475 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 20:42:15.371475 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 20:42:15.371475 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 20:42:15.373645 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 20:42:15.373645 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 15 20:42:15.373645 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 15 20:42:15.373645 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67ed2b36-9422-4f98-8a39-83c214eadae9 is not attached to volume d53b1f18-ab46-491c-8e05-f492a7fdb298 Jul 15 20:42:15.373645 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:42:15.373645 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:42:15.373645 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:42:15.373645 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:42:15.373645 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:42:15.373645 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:42:15.373645 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 20:42:15.373645 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 20:42:15.373645 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67ed2b36-9422-4f98-8a39-83c214eadae9 is not attached to volume d53b1f18-ab46-491c-8e05-f492a7fdb298 Jul 15 20:42:15.373645 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:42:15.373645 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-ddee1cdc-bc88-4795-be5b-527e68de3566 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Returning 404 to user: Instance 67ed2b36-9422-4f98-8a39-83c214eadae9 is not attached to volume d53b1f18-ab46-491c-8e05-f492a7fdb298 {{(pid=124432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 20:42:15.375139 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-ddee1cdc-bc88-4795-be5b-527e68de3566 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] 10.222.0.66 "DELETE /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9/os-volume_attachments/d53b1f18-ab46-491c-8e05-f492a7fdb298" status: 404 len: 154 microversion: 2.1 time: 0.089543 Jul 15 20:42:15.375139 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 352/704] 10.222.0.66 () {58 vars in 1415 bytes} [Fri Jul 15 20:42:15 2022] DELETE /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9/os-volume_attachments/d53b1f18-ab46-491c-8e05-f492a7fdb298 => generated 154 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 20:42:15.584359 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-b2b4c931-2095-44ef-a10c-1e26d373d864 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:15.584985 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-b2b4c931-2095-44ef-a10c-1e26d373d864 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 943a9a49-4fcd-46a5-b444-1a94f490ae2e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:15.590960 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b2b4c931-2095-44ef-a10c-1e26d373d864 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:15.592120 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b2b4c931-2095-44ef-a10c-1e26d373d864 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:15.592949 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b2b4c931-2095-44ef-a10c-1e26d373d864 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:15.593380 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b2b4c931-2095-44ef-a10c-1e26d373d864 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:15.614645 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:42:15.671809 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-fab953db-7519-4bb4-afdd-b29645f29ff9 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:15.672431 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-fab953db-7519-4bb4-afdd-b29645f29ff9 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 03bcc792-0b91-4282-a495-d8420a3602fc] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:15.679169 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fab953db-7519-4bb4-afdd-b29645f29ff9 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:15.679639 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fab953db-7519-4bb4-afdd-b29645f29ff9 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:15.681397 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fab953db-7519-4bb4-afdd-b29645f29ff9 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:15.682031 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fab953db-7519-4bb4-afdd-b29645f29ff9 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:15.763713 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-b2b4c931-2095-44ef-a10c-1e26d373d864 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:42:15.771142 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-b2b4c931-2095-44ef-a10c-1e26d373d864 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e" status: 200 len: 1691 microversion: 2.1 time: 0.190580 Jul 15 20:42:15.771729 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 353/705] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:42:15 2022] GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e => generated 1691 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:42:15.829244 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-fab953db-7519-4bb4-afdd-b29645f29ff9 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:42:15.836854 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-fab953db-7519-4bb4-afdd-b29645f29ff9 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/03bcc792-0b91-4282-a495-d8420a3602fc" status: 200 len: 1557 microversion: 2.1 time: 0.169268 Jul 15 20:42:15.837416 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 353/706] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:42:15 2022] GET /compute/v2.1/servers/03bcc792-0b91-4282-a495-d8420a3602fc => generated 1557 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:42:15.854167 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-b39117f8-7ab7-4b3a-b3fd-37bd786660ac tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:15.854662 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-b39117f8-7ab7-4b3a-b3fd-37bd786660ac tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 03bcc792-0b91-4282-a495-d8420a3602fc] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:15.861152 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b39117f8-7ab7-4b3a-b3fd-37bd786660ac tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:15.861603 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b39117f8-7ab7-4b3a-b3fd-37bd786660ac tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:15.862362 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b39117f8-7ab7-4b3a-b3fd-37bd786660ac tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:15.862797 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b39117f8-7ab7-4b3a-b3fd-37bd786660ac tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:15.943941 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-b39117f8-7ab7-4b3a-b3fd-37bd786660ac tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/03bcc792-0b91-4282-a495-d8420a3602fc/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093489 Jul 15 20:42:15.944555 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 354/707] 10.222.0.66 () {58 vars in 1274 bytes} [Fri Jul 15 20:42:15 2022] GET /compute/v2.1/servers/03bcc792-0b91-4282-a495-d8420a3602fc/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:42:16.510329 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-9a7c24be-3aaf-4a11-a41e-60b1e8f7b9c1 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:16.510823 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-9a7c24be-3aaf-4a11-a41e-60b1e8f7b9c1 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] [instance: 67ed2b36-9422-4f98-8a39-83c214eadae9] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:16.517331 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9a7c24be-3aaf-4a11-a41e-60b1e8f7b9c1 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:16.517769 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9a7c24be-3aaf-4a11-a41e-60b1e8f7b9c1 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:16.518518 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9a7c24be-3aaf-4a11-a41e-60b1e8f7b9c1 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:16.518942 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9a7c24be-3aaf-4a11-a41e-60b1e8f7b9c1 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:16.543218 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-9a7c24be-3aaf-4a11-a41e-60b1e8f7b9c1 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] [instance: 67ed2b36-9422-4f98-8a39-83c214eadae9] Going to try to terminate instance {{(pid=124432) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 20:42:16.619435 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-9a7c24be-3aaf-4a11-a41e-60b1e8f7b9c1 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] 10.222.0.66 "DELETE /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9" status: 204 len: 0 microversion: 2.1 time: 0.112839 Jul 15 20:42:16.620015 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 354/708] 10.222.0.66 () {58 vars in 1238 bytes} [Fri Jul 15 20:42:16 2022] DELETE /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 20:42:16.629269 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-6b7998cd-77ae-4362-bb14-f98d69da5139 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:16.630008 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-6b7998cd-77ae-4362-bb14-f98d69da5139 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] [instance: 67ed2b36-9422-4f98-8a39-83c214eadae9] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:16.636339 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-6b7998cd-77ae-4362-bb14-f98d69da5139 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:16.636848 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-6b7998cd-77ae-4362-bb14-f98d69da5139 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:16.637639 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-6b7998cd-77ae-4362-bb14-f98d69da5139 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:16.638676 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-6b7998cd-77ae-4362-bb14-f98d69da5139 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:16.789910 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-bc3cedf8-8b97-4c1c-ac97-745c7813a462 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:16.790788 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-bc3cedf8-8b97-4c1c-ac97-745c7813a462 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 943a9a49-4fcd-46a5-b444-1a94f490ae2e] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:16.797716 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-bc3cedf8-8b97-4c1c-ac97-745c7813a462 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:16.798173 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-bc3cedf8-8b97-4c1c-ac97-745c7813a462 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:16.798938 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-bc3cedf8-8b97-4c1c-ac97-745c7813a462 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:16.799369 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-bc3cedf8-8b97-4c1c-ac97-745c7813a462 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:16.803434 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:42:16.837060 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-6b7998cd-77ae-4362-bb14-f98d69da5139 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a573525d244ab3ab69095db8871f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d62130d6f74b8e919e429cbb3afc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:42:16.847316 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-6b7998cd-77ae-4362-bb14-f98d69da5139 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] 10.222.0.66 "GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9" status: 200 len: 1554 microversion: 2.1 time: 0.222298 Jul 15 20:42:16.847890 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 355/709] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:42:16 2022] GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9 => generated 1554 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:42:17.238050 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-bc3cedf8-8b97-4c1c-ac97-745c7813a462 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:42:17.246693 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-bc3cedf8-8b97-4c1c-ac97-745c7813a462 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e" status: 200 len: 1691 microversion: 2.1 time: 0.461010 Jul 15 20:42:17.247789 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 355/710] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:42:16 2022] GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e => generated 1691 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:42:17.301376 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [req-b0689424-de0b-4faf-a570-878c71174bfe req-30068516-b408-4583-a037-2dbf703b2580 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03bcc792-0b91-4282-a495-d8420a3602fc", "tag": "997ebb45-8116-4a67-8134-9843c9d6226d"}]} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:42:17.309900 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-b0689424-de0b-4faf-a570-878c71174bfe req-30068516-b408-4583-a037-2dbf703b2580 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:17.310498 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-b0689424-de0b-4faf-a570-878c71174bfe req-30068516-b408-4583-a037-2dbf703b2580 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:17.321575 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.compute.server_external_events [req-b0689424-de0b-4faf-a570-878c71174bfe req-30068516-b408-4583-a037-2dbf703b2580 service nova] Creating event network-changed:997ebb45-8116-4a67-8134-9843c9d6226d for instance 03bcc792-0b91-4282-a495-d8420a3602fc on hv-cinder-79987 Jul 15 20:42:17.327334 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [req-b0689424-de0b-4faf-a570-878c71174bfe req-30068516-b408-4583-a037-2dbf703b2580 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094061 Jul 15 20:42:17.327942 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 356/711] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:42:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 20:42:17.865971 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-26263ee4-9cf2-4a1d-8efa-616e808693d8 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:17.866691 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-26263ee4-9cf2-4a1d-8efa-616e808693d8 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] [instance: 67ed2b36-9422-4f98-8a39-83c214eadae9] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:17.874009 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-26263ee4-9cf2-4a1d-8efa-616e808693d8 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:17.874456 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-26263ee4-9cf2-4a1d-8efa-616e808693d8 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:17.875212 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-26263ee4-9cf2-4a1d-8efa-616e808693d8 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:17.875635 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-26263ee4-9cf2-4a1d-8efa-616e808693d8 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:18.027171 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-26263ee4-9cf2-4a1d-8efa-616e808693d8 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a573525d244ab3ab69095db8871f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d62130d6f74b8e919e429cbb3afc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:42:18.035994 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-26263ee4-9cf2-4a1d-8efa-616e808693d8 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] 10.222.0.66 "GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9" status: 200 len: 1554 microversion: 2.1 time: 0.173583 Jul 15 20:42:18.036756 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 356/712] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:42:17 2022] GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9 => generated 1554 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:42:18.264690 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-3cabd1e6-de4d-44ed-8c8c-1d0d3b093681 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:18.265402 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-3cabd1e6-de4d-44ed-8c8c-1d0d3b093681 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 943a9a49-4fcd-46a5-b444-1a94f490ae2e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:18.272262 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-3cabd1e6-de4d-44ed-8c8c-1d0d3b093681 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:18.272798 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-3cabd1e6-de4d-44ed-8c8c-1d0d3b093681 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:18.273520 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-3cabd1e6-de4d-44ed-8c8c-1d0d3b093681 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:18.273960 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-3cabd1e6-de4d-44ed-8c8c-1d0d3b093681 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:18.402751 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-3cabd1e6-de4d-44ed-8c8c-1d0d3b093681 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:42:18.410474 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-3cabd1e6-de4d-44ed-8c8c-1d0d3b093681 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e" status: 200 len: 1691 microversion: 2.1 time: 0.151128 Jul 15 20:42:18.411040 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 357/713] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:42:18 2022] GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e => generated 1691 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:42:19.054029 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-74be9d13-2e5f-48a1-90d1-e2d597fae238 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:19.054637 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-74be9d13-2e5f-48a1-90d1-e2d597fae238 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] [instance: 67ed2b36-9422-4f98-8a39-83c214eadae9] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:19.061357 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-74be9d13-2e5f-48a1-90d1-e2d597fae238 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:19.061831 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-74be9d13-2e5f-48a1-90d1-e2d597fae238 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:19.062586 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-74be9d13-2e5f-48a1-90d1-e2d597fae238 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:19.063017 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-74be9d13-2e5f-48a1-90d1-e2d597fae238 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:19.193255 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-74be9d13-2e5f-48a1-90d1-e2d597fae238 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a573525d244ab3ab69095db8871f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d62130d6f74b8e919e429cbb3afc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:42:19.201362 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-74be9d13-2e5f-48a1-90d1-e2d597fae238 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] 10.222.0.66 "GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9" status: 200 len: 1554 microversion: 2.1 time: 0.150539 Jul 15 20:42:19.201951 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 357/714] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:42:19 2022] GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9 => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:42:19.427184 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-1327fcc2-436e-4bf4-b0d4-7493ad898206 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:19.427795 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-1327fcc2-436e-4bf4-b0d4-7493ad898206 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 943a9a49-4fcd-46a5-b444-1a94f490ae2e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:19.434295 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-1327fcc2-436e-4bf4-b0d4-7493ad898206 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:19.435425 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-1327fcc2-436e-4bf4-b0d4-7493ad898206 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:19.436495 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-1327fcc2-436e-4bf4-b0d4-7493ad898206 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:19.436935 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-1327fcc2-436e-4bf4-b0d4-7493ad898206 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:19.566736 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-1327fcc2-436e-4bf4-b0d4-7493ad898206 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:42:19.574793 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-1327fcc2-436e-4bf4-b0d4-7493ad898206 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e" status: 200 len: 1691 microversion: 2.1 time: 0.151572 Jul 15 20:42:19.575413 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 358/715] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:42:19 2022] GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e => generated 1691 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:42:20.218658 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-dee310fe-1360-4ce0-b30f-beabe9485a2f tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:20.219263 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-dee310fe-1360-4ce0-b30f-beabe9485a2f tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] [instance: 67ed2b36-9422-4f98-8a39-83c214eadae9] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:20.225747 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-dee310fe-1360-4ce0-b30f-beabe9485a2f tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:20.226193 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-dee310fe-1360-4ce0-b30f-beabe9485a2f tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:20.226979 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-dee310fe-1360-4ce0-b30f-beabe9485a2f tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:20.227410 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-dee310fe-1360-4ce0-b30f-beabe9485a2f tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:20.358540 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-dee310fe-1360-4ce0-b30f-beabe9485a2f tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a573525d244ab3ab69095db8871f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d62130d6f74b8e919e429cbb3afc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:42:20.366002 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-dee310fe-1360-4ce0-b30f-beabe9485a2f tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] 10.222.0.66 "GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9" status: 200 len: 1554 microversion: 2.1 time: 0.151482 Jul 15 20:42:20.366563 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 358/716] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:42:20 2022] GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9 => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:42:20.592253 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-00c8980f-1c8b-4c0e-b646-d6a6754efe19 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:20.592914 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-00c8980f-1c8b-4c0e-b646-d6a6754efe19 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 943a9a49-4fcd-46a5-b444-1a94f490ae2e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:20.599366 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-00c8980f-1c8b-4c0e-b646-d6a6754efe19 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:20.599814 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-00c8980f-1c8b-4c0e-b646-d6a6754efe19 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:20.600731 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-00c8980f-1c8b-4c0e-b646-d6a6754efe19 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:20.601168 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-00c8980f-1c8b-4c0e-b646-d6a6754efe19 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:20.739805 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-00c8980f-1c8b-4c0e-b646-d6a6754efe19 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:42:20.748141 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-00c8980f-1c8b-4c0e-b646-d6a6754efe19 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e" status: 200 len: 1691 microversion: 2.1 time: 0.160981 Jul 15 20:42:20.748963 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 359/717] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:42:20 2022] GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e => generated 1691 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:42:21.385690 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-f37fec51-1682-4066-9ef6-012e4531d3fa tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:21.387825 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-f37fec51-1682-4066-9ef6-012e4531d3fa tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] [instance: 67ed2b36-9422-4f98-8a39-83c214eadae9] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:21.400858 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-654f7f8b-be91-434e-84b1-c94c29b7d80a req-50d16e03-aedc-44bf-88cf-a47f243d01f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67ed2b36-9422-4f98-8a39-83c214eadae9", "name": "network-vif-deleted", "tag": "138653ff-cbaa-43a2-9358-b327bc394857"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:42:21.402581 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-f37fec51-1682-4066-9ef6-012e4531d3fa tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:21.403872 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-f37fec51-1682-4066-9ef6-012e4531d3fa tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:21.405583 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-f37fec51-1682-4066-9ef6-012e4531d3fa tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:21.406245 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-f37fec51-1682-4066-9ef6-012e4531d3fa tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:21.420150 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-654f7f8b-be91-434e-84b1-c94c29b7d80a req-50d16e03-aedc-44bf-88cf-a47f243d01f7 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:21.422028 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-654f7f8b-be91-434e-84b1-c94c29b7d80a req-50d16e03-aedc-44bf-88cf-a47f243d01f7 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:21.446352 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-654f7f8b-be91-434e-84b1-c94c29b7d80a req-50d16e03-aedc-44bf-88cf-a47f243d01f7 service nova] Creating event network-vif-deleted:138653ff-cbaa-43a2-9358-b327bc394857 for instance 67ed2b36-9422-4f98-8a39-83c214eadae9 on hv-cinder-79987 Jul 15 20:42:21.452382 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-654f7f8b-be91-434e-84b1-c94c29b7d80a req-50d16e03-aedc-44bf-88cf-a47f243d01f7 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139437 Jul 15 20:42:21.459236 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 359/718] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:42:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 20:42:21.480007 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-f37fec51-1682-4066-9ef6-012e4531d3fa tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a573525d244ab3ab69095db8871f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d62130d6f74b8e919e429cbb3afc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:42:21.488324 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-f37fec51-1682-4066-9ef6-012e4531d3fa tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] 10.222.0.66 "GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9" status: 200 len: 1343 microversion: 2.1 time: 0.109069 Jul 15 20:42:21.488936 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 360/719] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:42:21 2022] GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9 => generated 1343 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:42:21.767845 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-620259e7-3dbf-45bd-a62d-a127d0d575c4 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:21.769117 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-620259e7-3dbf-45bd-a62d-a127d0d575c4 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 943a9a49-4fcd-46a5-b444-1a94f490ae2e] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:21.776064 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-620259e7-3dbf-45bd-a62d-a127d0d575c4 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:21.776789 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-620259e7-3dbf-45bd-a62d-a127d0d575c4 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:21.777728 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-620259e7-3dbf-45bd-a62d-a127d0d575c4 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:21.778957 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-620259e7-3dbf-45bd-a62d-a127d0d575c4 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:21.856895 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-620259e7-3dbf-45bd-a62d-a127d0d575c4 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:42:21.865755 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-620259e7-3dbf-45bd-a62d-a127d0d575c4 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e" status: 200 len: 1330 microversion: 2.1 time: 0.103805 Jul 15 20:42:21.866687 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 360/720] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:42:21 2022] GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e => generated 1330 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:42:22.507399 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-c9f05ba1-75b3-4d7c-b0af-f6c215b301d7 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:22.508133 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-c9f05ba1-75b3-4d7c-b0af-f6c215b301d7 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] [instance: 67ed2b36-9422-4f98-8a39-83c214eadae9] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:22.515473 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c9f05ba1-75b3-4d7c-b0af-f6c215b301d7 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:22.515967 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c9f05ba1-75b3-4d7c-b0af-f6c215b301d7 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:22.516798 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c9f05ba1-75b3-4d7c-b0af-f6c215b301d7 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:22.517235 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c9f05ba1-75b3-4d7c-b0af-f6c215b301d7 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:22.532042 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.wsgi [None req-c9f05ba1-75b3-4d7c-b0af-f6c215b301d7 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] HTTP exception thrown: Instance 67ed2b36-9422-4f98-8a39-83c214eadae9 could not be found. Jul 15 20:42:22.533764 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-c9f05ba1-75b3-4d7c-b0af-f6c215b301d7 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Request method failure captured: Jul 15 20:42:22.533764 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: request: GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9 HTTP/1.1 Jul 15 20:42:22.533764 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Accept: application/json Jul 15 20:42:22.533764 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Accept-Encoding: identity Jul 15 20:42:22.533764 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Connection: close Jul 15 20:42:22.533764 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Content-Length: 0 Jul 15 20:42:22.533764 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Content-Type: application/json Jul 15 20:42:22.533764 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Host: 10.222.0.66 Jul 15 20:42:22.533764 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Openstack-System-Scope: None Jul 15 20:42:22.533764 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: User-Agent: python-urllib3/1.26.9 Jul 15 20:42:22.533764 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Auth-Token: gAAAAABi0dCCTx3lkfOMcQToALH4P48Rgk_HGvXqzOkdqT3egFr5eytuibRWoF7N7nBLt7j4mZYe5cF6g6OBO1AuXANA3RyAPbl15lvb0dhUwJfRL0qqC4y08cfEqRrII_Y4pZFkUqhtBO9q69QWpP3VlThuVWefdIui_wGuzNG_8gjuxX7u_E8 Jul 15 20:42:22.533764 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Domain-Id: None Jul 15 20:42:22.533764 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Domain-Name: None Jul 15 20:42:22.533764 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Identity-Status: Confirmed Jul 15 20:42:22.533764 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Is-Admin-Project: True Jul 15 20:42:22.533764 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Domain-Id: default Jul 15 20:42:22.533764 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Domain-Name: Default Jul 15 20:42:22.533764 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Id: 37d62130d6f74b8e919e429cbb3afc55 Jul 15 20:42:22.533764 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Name: tempest-TestMinimumBasicScenario-67481712 Jul 15 20:42:22.533764 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Role: member,reader Jul 15 20:42:22.533764 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Roles: member,reader Jul 15 20:42:22.535355 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/37d62130d6f74b8e919e429cbb3afc55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_37d62130d6f74b8e919e429cbb3afc55"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/37d62130d6f74b8e919e429cbb3afc55"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/37d62130d6f74b8e919e429cbb3afc55"}]}] Jul 15 20:42:22.535355 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant: tempest-TestMinimumBasicScenario-67481712 Jul 15 20:42:22.535355 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant-Id: 37d62130d6f74b8e919e429cbb3afc55 Jul 15 20:42:22.535355 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant-Name: tempest-TestMinimumBasicScenario-67481712 Jul 15 20:42:22.535355 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User: tempest-TestMinimumBasicScenario-67481712-project Jul 15 20:42:22.535355 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Domain-Id: default Jul 15 20:42:22.535355 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Domain-Name: Default Jul 15 20:42:22.535355 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Id: 30a573525d244ab3ab69095db8871f20 Jul 15 20:42:22.535355 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Name: tempest-TestMinimumBasicScenario-67481712-project Jul 15 20:42:22.535355 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: method: > Jul 15 20:42:22.535355 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: exception: Instance 67ed2b36-9422-4f98-8a39-83c214eadae9 could not be found. Jul 15 20:42:22.535355 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: action_args: {'id': '67ed2b36-9422-4f98-8a39-83c214eadae9'} Jul 15 20:42:22.536289 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 20:42:22.536289 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:42:22.536289 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 20:42:22.536289 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 20:42:22.536289 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 20:42:22.536289 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 20:42:22.536289 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 20:42:22.536289 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 20:42:22.536289 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 20:42:22.536289 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 20:42:22.536289 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67ed2b36-9422-4f98-8a39-83c214eadae9 could not be found. Jul 15 20:42:22.536289 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:42:22.536289 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:42:22.536289 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:42:22.536289 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:42:22.536289 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:42:22.536289 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:42:22.536289 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 20:42:22.536289 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 20:42:22.536289 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 20:42:22.537902 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 20:42:22.537902 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 20:42:22.537902 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 20:42:22.537902 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 20:42:22.537902 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 20:42:22.537902 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 20:42:22.537902 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 20:42:22.537902 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67ed2b36-9422-4f98-8a39-83c214eadae9 could not be found. Jul 15 20:42:22.537902 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:42:22.537902 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:42:22.537902 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:42:22.537902 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:42:22.537902 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:42:22.537902 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:42:22.537902 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 20:42:22.537902 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 20:42:22.537902 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67ed2b36-9422-4f98-8a39-83c214eadae9 could not be found. Jul 15 20:42:22.537902 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:42:22.539167 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-c9f05ba1-75b3-4d7c-b0af-f6c215b301d7 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Returning 404 to user: Instance 67ed2b36-9422-4f98-8a39-83c214eadae9 could not be found. {{(pid=124430) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 20:42:22.539167 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-c9f05ba1-75b3-4d7c-b0af-f6c215b301d7 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] 10.222.0.66 "GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9" status: 404 len: 111 microversion: 2.1 time: 0.031858 Jul 15 20:42:22.539167 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 361/721] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:42:22 2022] GET /compute/v2.1/servers/67ed2b36-9422-4f98-8a39-83c214eadae9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 20:42:22.544197 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-db80a204-1891-418f-b1c4-b6f387fd9693 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] Calling method '.version_select at 0x7ff51849c700>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:22.562846 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-db80a204-1891-418f-b1c4-b6f387fd9693 tempest-TestMinimumBasicScenario-67481712 tempest-TestMinimumBasicScenario-67481712-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1508719023" status: 202 len: 0 microversion: 2.1 time: 0.022578 Jul 15 20:42:22.563418 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 361/722] 10.222.0.66 () {58 vars in 1271 bytes} [Fri Jul 15 20:42:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1508719023 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 20:42:22.883778 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-cfcd3963-986c-4690-93c8-7565a8fc72a2 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:22.884441 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-cfcd3963-986c-4690-93c8-7565a8fc72a2 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 943a9a49-4fcd-46a5-b444-1a94f490ae2e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:22.893221 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-cfcd3963-986c-4690-93c8-7565a8fc72a2 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:22.893626 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-cfcd3963-986c-4690-93c8-7565a8fc72a2 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:22.894844 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-cfcd3963-986c-4690-93c8-7565a8fc72a2 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:22.894985 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-cfcd3963-986c-4690-93c8-7565a8fc72a2 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:22.911915 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.wsgi [None req-cfcd3963-986c-4690-93c8-7565a8fc72a2 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] HTTP exception thrown: Instance 943a9a49-4fcd-46a5-b444-1a94f490ae2e could not be found. Jul 15 20:42:22.913622 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-cfcd3963-986c-4690-93c8-7565a8fc72a2 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Request method failure captured: Jul 15 20:42:22.913622 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: request: GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e HTTP/1.1 Jul 15 20:42:22.913622 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Accept: application/json Jul 15 20:42:22.913622 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Accept-Encoding: identity Jul 15 20:42:22.913622 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Connection: close Jul 15 20:42:22.913622 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Content-Length: 0 Jul 15 20:42:22.913622 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Content-Type: application/json Jul 15 20:42:22.913622 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Host: 10.222.0.66 Jul 15 20:42:22.913622 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Openstack-System-Scope: None Jul 15 20:42:22.913622 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: User-Agent: python-urllib3/1.26.9 Jul 15 20:42:22.913622 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Auth-Token: gAAAAABi0c_lkbnVJwqH3IpbVZVWMQ8HLL8u6A1nS9xbrwR6NEMpzbfmtKxCTl345tuTNHTXVBkYUfn70H4FibX8wPsRThE1aLHTgYmYauzCicRFu1CJ8qFyi1jEF3aSJLDbXxeN4ZX8G4ZQcm6oZkgRw4bn00Q4s9ZTfchWhd2dhVKZ6EVvqgw Jul 15 20:42:22.913622 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Domain-Id: None Jul 15 20:42:22.913622 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Domain-Name: None Jul 15 20:42:22.913622 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Identity-Status: Confirmed Jul 15 20:42:22.913622 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Is-Admin-Project: True Jul 15 20:42:22.913622 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Domain-Id: default Jul 15 20:42:22.913622 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Domain-Name: Default Jul 15 20:42:22.913622 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Id: 0395d91380b34e968d7e39be3bc88b0f Jul 15 20:42:22.913622 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1747571758 Jul 15 20:42:22.913622 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Role: member,reader Jul 15 20:42:22.913622 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Roles: member,reader Jul 15 20:42:22.915261 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0395d91380b34e968d7e39be3bc88b0f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_0395d91380b34e968d7e39be3bc88b0f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0395d91380b34e968d7e39be3bc88b0f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/0395d91380b34e968d7e39be3bc88b0f"}]}] Jul 15 20:42:22.915261 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1747571758 Jul 15 20:42:22.915261 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant-Id: 0395d91380b34e968d7e39be3bc88b0f Jul 15 20:42:22.915261 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1747571758 Jul 15 20:42:22.915261 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User: tempest-ServerRescueNegativeTestJSON-1747571758-project Jul 15 20:42:22.915261 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Domain-Id: default Jul 15 20:42:22.915261 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Domain-Name: Default Jul 15 20:42:22.915261 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Id: e13d5d7068e348248387b512c55dec5e Jul 15 20:42:22.915261 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1747571758-project Jul 15 20:42:22.915261 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: method: > Jul 15 20:42:22.915261 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: exception: Instance 943a9a49-4fcd-46a5-b444-1a94f490ae2e could not be found. Jul 15 20:42:22.915261 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: action_args: {'id': '943a9a49-4fcd-46a5-b444-1a94f490ae2e'} Jul 15 20:42:22.916715 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 20:42:22.916715 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:42:22.916715 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 20:42:22.916715 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 20:42:22.916715 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 20:42:22.916715 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 20:42:22.916715 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 20:42:22.916715 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 20:42:22.916715 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 20:42:22.916715 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 20:42:22.916715 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 943a9a49-4fcd-46a5-b444-1a94f490ae2e could not be found. Jul 15 20:42:22.916715 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:42:22.916715 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:42:22.916715 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:42:22.916715 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:42:22.916715 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:42:22.916715 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:42:22.916715 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 20:42:22.916715 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 20:42:22.916715 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 20:42:22.918474 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 20:42:22.918474 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 20:42:22.918474 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 20:42:22.918474 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 20:42:22.918474 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 20:42:22.918474 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 20:42:22.918474 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 20:42:22.918474 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 943a9a49-4fcd-46a5-b444-1a94f490ae2e could not be found. Jul 15 20:42:22.918474 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:42:22.918474 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:42:22.918474 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:42:22.918474 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:42:22.918474 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:42:22.918474 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:42:22.918474 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 20:42:22.918474 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 20:42:22.918474 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 943a9a49-4fcd-46a5-b444-1a94f490ae2e could not be found. Jul 15 20:42:22.918474 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:42:22.920215 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-cfcd3963-986c-4690-93c8-7565a8fc72a2 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Returning 404 to user: Instance 943a9a49-4fcd-46a5-b444-1a94f490ae2e could not be found. {{(pid=124430) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 20:42:22.920215 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-cfcd3963-986c-4690-93c8-7565a8fc72a2 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e" status: 404 len: 111 microversion: 2.1 time: 0.035973 Jul 15 20:42:22.920215 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 362/723] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:42:22 2022] GET /compute/v2.1/servers/943a9a49-4fcd-46a5-b444-1a94f490ae2e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 20:42:22.926018 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-a5859829-757d-461d-87ba-b7453bb2e7f2 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '.version_select at 0x7ff5180411f0>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:22.949188 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-a5859829-757d-461d-87ba-b7453bb2e7f2 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1818393167" status: 202 len: 0 microversion: 2.1 time: 0.027011 Jul 15 20:42:22.949932 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 362/724] 10.222.0.66 () {58 vars in 1220 bytes} [Fri Jul 15 20:42:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1818393167 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 20:42:23.487598 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [req-5e0fdafa-5699-4891-af6e-455f0c6c4528 req-6fa54190-ba05-4a13-813b-7ddd29e0e71e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "943a9a49-4fcd-46a5-b444-1a94f490ae2e", "name": "network-vif-deleted", "tag": "96d2f7c9-c3d8-4750-b9d0-3ab318ff06a1"}]} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:42:23.495988 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-5e0fdafa-5699-4891-af6e-455f0c6c4528 req-6fa54190-ba05-4a13-813b-7ddd29e0e71e service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:23.496768 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-5e0fdafa-5699-4891-af6e-455f0c6c4528 req-6fa54190-ba05-4a13-813b-7ddd29e0e71e service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:23.509628 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.compute.server_external_events [req-5e0fdafa-5699-4891-af6e-455f0c6c4528 req-6fa54190-ba05-4a13-813b-7ddd29e0e71e service nova] Creating event network-vif-deleted:96d2f7c9-c3d8-4750-b9d0-3ab318ff06a1 for instance 943a9a49-4fcd-46a5-b444-1a94f490ae2e on hv-cinder-79987 Jul 15 20:42:23.515870 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [req-5e0fdafa-5699-4891-af6e-455f0c6c4528 req-6fa54190-ba05-4a13-813b-7ddd29e0e71e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031704 Jul 15 20:42:23.516710 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 363/725] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:42:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 20:42:25.870961 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-c2e8ee94-3c98-4fd7-8f55-bd3970d07abc tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:25.871458 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-c2e8ee94-3c98-4fd7-8f55-bd3970d07abc tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:25.879106 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c2e8ee94-3c98-4fd7-8f55-bd3970d07abc tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:25.880453 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c2e8ee94-3c98-4fd7-8f55-bd3970d07abc tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:25.881258 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c2e8ee94-3c98-4fd7-8f55-bd3970d07abc tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:25.881697 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c2e8ee94-3c98-4fd7-8f55-bd3970d07abc tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:25.909400 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-c2e8ee94-3c98-4fd7-8f55-bd3970d07abc tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Going to try to terminate instance {{(pid=124432) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 20:42:26.002265 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-c2e8ee94-3c98-4fd7-8f55-bd3970d07abc tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "DELETE /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc" status: 204 len: 0 microversion: 2.1 time: 0.130958 Jul 15 20:42:26.004626 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 363/726] 10.222.0.66 () {58 vars in 1238 bytes} [Fri Jul 15 20:42:25 2022] DELETE /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 20:42:26.014833 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-4b4b6417-ed5f-4185-a0f5-baf7a8fb86d3 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:26.017642 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-4b4b6417-ed5f-4185-a0f5-baf7a8fb86d3 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:26.026494 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-4b4b6417-ed5f-4185-a0f5-baf7a8fb86d3 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:26.026946 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-4b4b6417-ed5f-4185-a0f5-baf7a8fb86d3 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:26.032283 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-4b4b6417-ed5f-4185-a0f5-baf7a8fb86d3 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:26.032775 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-4b4b6417-ed5f-4185-a0f5-baf7a8fb86d3 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:26.286502 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-4b4b6417-ed5f-4185-a0f5-baf7a8fb86d3 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:42:26.301156 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-4b4b6417-ed5f-4185-a0f5-baf7a8fb86d3 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc" status: 200 len: 1508 microversion: 2.1 time: 0.291991 Jul 15 20:42:26.301974 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 364/727] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:42:26 2022] GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc => generated 1508 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:42:27.319694 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-86e507ae-390e-4fca-b010-49184994ffa5 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:27.320554 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-86e507ae-390e-4fca-b010-49184994ffa5 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:27.327261 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-86e507ae-390e-4fca-b010-49184994ffa5 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:27.327713 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-86e507ae-390e-4fca-b010-49184994ffa5 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:27.328515 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-86e507ae-390e-4fca-b010-49184994ffa5 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:27.328951 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-86e507ae-390e-4fca-b010-49184994ffa5 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:27.473316 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-86e507ae-390e-4fca-b010-49184994ffa5 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:42:27.481076 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-86e507ae-390e-4fca-b010-49184994ffa5 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc" status: 200 len: 1508 microversion: 2.1 time: 0.165616 Jul 15 20:42:27.482533 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 364/728] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:42:27 2022] GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc => generated 1508 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:42:28.499398 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-7d7f872f-ff90-49ed-9526-a837afc12b4e tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:28.500170 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-7d7f872f-ff90-49ed-9526-a837afc12b4e tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:28.507087 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-7d7f872f-ff90-49ed-9526-a837afc12b4e tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:28.507820 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-7d7f872f-ff90-49ed-9526-a837afc12b4e tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:28.508838 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-7d7f872f-ff90-49ed-9526-a837afc12b4e tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:28.509503 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-7d7f872f-ff90-49ed-9526-a837afc12b4e tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:28.650431 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-7d7f872f-ff90-49ed-9526-a837afc12b4e tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:42:28.660090 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-7d7f872f-ff90-49ed-9526-a837afc12b4e tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc" status: 200 len: 1508 microversion: 2.1 time: 0.166368 Jul 15 20:42:28.661109 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 365/729] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:42:28 2022] GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc => generated 1508 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:42:29.321095 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-4bb8b2f2-90bb-4265-8b01-c75f82090d39 req-c86067a6-fdb6-4da4-aca6-000575d3bfe9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef881276-4314-4f71-8f0e-195af41473bc", "name": "network-vif-deleted", "tag": "d7772a75-e1a3-43d1-9412-92dff1189079"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:42:29.331929 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-4bb8b2f2-90bb-4265-8b01-c75f82090d39 req-c86067a6-fdb6-4da4-aca6-000575d3bfe9 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:29.341215 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-4bb8b2f2-90bb-4265-8b01-c75f82090d39 req-c86067a6-fdb6-4da4-aca6-000575d3bfe9 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:29.352928 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-4bb8b2f2-90bb-4265-8b01-c75f82090d39 req-c86067a6-fdb6-4da4-aca6-000575d3bfe9 service nova] Creating event network-vif-deleted:d7772a75-e1a3-43d1-9412-92dff1189079 for instance ef881276-4314-4f71-8f0e-195af41473bc on hv-cinder-79987 Jul 15 20:42:29.358772 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-4bb8b2f2-90bb-4265-8b01-c75f82090d39 req-c86067a6-fdb6-4da4-aca6-000575d3bfe9 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041747 Jul 15 20:42:29.360107 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 365/730] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:42:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:42:29.677865 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-1e27ba17-54cc-4460-9294-6b152b66c08c tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:29.678473 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-1e27ba17-54cc-4460-9294-6b152b66c08c tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:29.685466 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-1e27ba17-54cc-4460-9294-6b152b66c08c tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:29.686041 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-1e27ba17-54cc-4460-9294-6b152b66c08c tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:29.687000 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-1e27ba17-54cc-4460-9294-6b152b66c08c tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:29.687440 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-1e27ba17-54cc-4460-9294-6b152b66c08c tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:29.723104 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-1e27ba17-54cc-4460-9294-6b152b66c08c tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:29.723559 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-1e27ba17-54cc-4460-9294-6b152b66c08c tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:29.724012 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.objects.instance [None req-1e27ba17-54cc-4460-9294-6b152b66c08c tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lazy-loading 'fault' on Instance uuid ef881276-4314-4f71-8f0e-195af41473bc {{(pid=124430) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 20:42:29.772792 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-1e27ba17-54cc-4460-9294-6b152b66c08c tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:42:29.781810 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-1e27ba17-54cc-4460-9294-6b152b66c08c tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc" status: 200 len: 1312 microversion: 2.1 time: 0.107667 Jul 15 20:42:29.782700 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 366/731] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:42:29 2022] GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc => generated 1312 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:42:30.260303 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-38852782-5916-4ee1-90a9-736627cc8a2c tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:30.262534 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-38852782-5916-4ee1-90a9-736627cc8a2c tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:30.271594 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-38852782-5916-4ee1-90a9-736627cc8a2c tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:30.272095 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-38852782-5916-4ee1-90a9-736627cc8a2c tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:30.272930 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-38852782-5916-4ee1-90a9-736627cc8a2c tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:30.273364 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-38852782-5916-4ee1-90a9-736627cc8a2c tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:30.309712 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-38852782-5916-4ee1-90a9-736627cc8a2c tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.062734 Jul 15 20:42:30.310538 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 366/732] 10.222.0.66 () {58 vars in 1301 bytes} [Fri Jul 15 20:42:30 2022] GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 15 20:42:30.375817 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-07d58e67-123e-45ef-817d-d618f9797539 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:30.375817 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-07d58e67-123e-45ef-817d-d618f9797539 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:30.381230 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-07d58e67-123e-45ef-817d-d618f9797539 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:30.381672 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-07d58e67-123e-45ef-817d-d618f9797539 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:30.382438 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-07d58e67-123e-45ef-817d-d618f9797539 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:30.383085 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-07d58e67-123e-45ef-817d-d618f9797539 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:30.409229 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-07d58e67-123e-45ef-817d-d618f9797539 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e] Going to try to terminate instance {{(pid=124430) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 20:42:30.508533 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-07d58e67-123e-45ef-817d-d618f9797539 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "DELETE /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e" status: 204 len: 0 microversion: 2.1 time: 0.138697 Jul 15 20:42:30.509127 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 367/733] 10.222.0.66 () {58 vars in 1238 bytes} [Fri Jul 15 20:42:30 2022] DELETE /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 20:42:30.517967 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-91bc12d7-ebc1-429b-ab6d-567e07422553 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:30.518627 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-91bc12d7-ebc1-429b-ab6d-567e07422553 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:30.525626 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-91bc12d7-ebc1-429b-ab6d-567e07422553 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:30.526408 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-91bc12d7-ebc1-429b-ab6d-567e07422553 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:30.527292 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-91bc12d7-ebc1-429b-ab6d-567e07422553 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:30.527784 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-91bc12d7-ebc1-429b-ab6d-567e07422553 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:30.673738 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-91bc12d7-ebc1-429b-ab6d-567e07422553 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d12a685d9b419fa3606b5f4d1309fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af209f962144de4ae7e3575a3890096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:42:30.681097 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-91bc12d7-ebc1-429b-ab6d-567e07422553 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e" status: 200 len: 1671 microversion: 2.1 time: 0.167043 Jul 15 20:42:30.681951 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 367/734] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:42:30 2022] GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e => generated 1671 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:42:30.802369 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-46fd6858-c948-4925-a3e6-854b2773d99b tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:30.803198 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-46fd6858-c948-4925-a3e6-854b2773d99b tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: ef881276-4314-4f71-8f0e-195af41473bc] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:30.810499 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-46fd6858-c948-4925-a3e6-854b2773d99b tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:30.811199 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-46fd6858-c948-4925-a3e6-854b2773d99b tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:30.812043 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-46fd6858-c948-4925-a3e6-854b2773d99b tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:30.812503 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-46fd6858-c948-4925-a3e6-854b2773d99b tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:30.826726 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.wsgi [None req-46fd6858-c948-4925-a3e6-854b2773d99b tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] HTTP exception thrown: Instance ef881276-4314-4f71-8f0e-195af41473bc could not be found. Jul 15 20:42:30.828383 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-46fd6858-c948-4925-a3e6-854b2773d99b tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Request method failure captured: Jul 15 20:42:30.828383 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: request: GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc HTTP/1.1 Jul 15 20:42:30.828383 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Accept: application/json Jul 15 20:42:30.828383 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Accept-Encoding: identity Jul 15 20:42:30.828383 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Connection: close Jul 15 20:42:30.828383 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Content-Length: 0 Jul 15 20:42:30.828383 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Content-Type: application/json Jul 15 20:42:30.828383 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Host: 10.222.0.66 Jul 15 20:42:30.828383 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Openstack-System-Scope: None Jul 15 20:42:30.828383 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: User-Agent: python-urllib3/1.26.9 Jul 15 20:42:30.828383 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Auth-Token: gAAAAABi0c_lkbnVJwqH3IpbVZVWMQ8HLL8u6A1nS9xbrwR6NEMpzbfmtKxCTl345tuTNHTXVBkYUfn70H4FibX8wPsRThE1aLHTgYmYauzCicRFu1CJ8qFyi1jEF3aSJLDbXxeN4ZX8G4ZQcm6oZkgRw4bn00Q4s9ZTfchWhd2dhVKZ6EVvqgw Jul 15 20:42:30.828383 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Domain-Id: None Jul 15 20:42:30.828383 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Domain-Name: None Jul 15 20:42:30.828383 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Identity-Status: Confirmed Jul 15 20:42:30.828383 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Is-Admin-Project: True Jul 15 20:42:30.828383 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Domain-Id: default Jul 15 20:42:30.828383 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Domain-Name: Default Jul 15 20:42:30.828383 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Id: 0395d91380b34e968d7e39be3bc88b0f Jul 15 20:42:30.828383 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1747571758 Jul 15 20:42:30.828383 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Role: member,reader Jul 15 20:42:30.828383 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Roles: member,reader Jul 15 20:42:30.829744 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0395d91380b34e968d7e39be3bc88b0f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_0395d91380b34e968d7e39be3bc88b0f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0395d91380b34e968d7e39be3bc88b0f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/0395d91380b34e968d7e39be3bc88b0f"}]}] Jul 15 20:42:30.829744 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1747571758 Jul 15 20:42:30.829744 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant-Id: 0395d91380b34e968d7e39be3bc88b0f Jul 15 20:42:30.829744 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1747571758 Jul 15 20:42:30.829744 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User: tempest-ServerRescueNegativeTestJSON-1747571758-project Jul 15 20:42:30.829744 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Domain-Id: default Jul 15 20:42:30.829744 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Domain-Name: Default Jul 15 20:42:30.829744 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Id: e13d5d7068e348248387b512c55dec5e Jul 15 20:42:30.829744 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1747571758-project Jul 15 20:42:30.829744 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: method: > Jul 15 20:42:30.829744 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: exception: Instance ef881276-4314-4f71-8f0e-195af41473bc could not be found. Jul 15 20:42:30.829744 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: action_args: {'id': 'ef881276-4314-4f71-8f0e-195af41473bc'} Jul 15 20:42:30.830633 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 20:42:30.830633 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:42:30.830633 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 20:42:30.830633 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 20:42:30.830633 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 20:42:30.830633 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 20:42:30.830633 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 20:42:30.830633 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 20:42:30.830633 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 20:42:30.830633 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 20:42:30.830633 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef881276-4314-4f71-8f0e-195af41473bc could not be found. Jul 15 20:42:30.830633 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:42:30.830633 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:42:30.830633 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:42:30.830633 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:42:30.830633 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:42:30.830633 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:42:30.830633 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 20:42:30.830633 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 20:42:30.830633 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 20:42:30.831840 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 20:42:30.831840 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 20:42:30.831840 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 20:42:30.831840 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 20:42:30.831840 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 20:42:30.831840 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 20:42:30.831840 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 20:42:30.831840 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef881276-4314-4f71-8f0e-195af41473bc could not be found. Jul 15 20:42:30.831840 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:42:30.831840 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:42:30.831840 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:42:30.831840 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:42:30.831840 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:42:30.831840 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:42:30.831840 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 20:42:30.831840 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 20:42:30.831840 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef881276-4314-4f71-8f0e-195af41473bc could not be found. Jul 15 20:42:30.831840 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:42:30.833029 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-46fd6858-c948-4925-a3e6-854b2773d99b tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Returning 404 to user: Instance ef881276-4314-4f71-8f0e-195af41473bc could not be found. {{(pid=124430) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 20:42:30.833029 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-46fd6858-c948-4925-a3e6-854b2773d99b tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc" status: 404 len: 111 microversion: 2.1 time: 0.031650 Jul 15 20:42:30.833029 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 368/735] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:42:30 2022] GET /compute/v2.1/servers/ef881276-4314-4f71-8f0e-195af41473bc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 20:42:30.838451 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-4e1fca4b-a2d9-482b-a4b7-2821191f80e7 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:30.838947 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-4e1fca4b-a2d9-482b-a4b7-2821191f80e7 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 48c34b54-0234-4763-a6c1-f73c3c075277] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:30.844959 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4e1fca4b-a2d9-482b-a4b7-2821191f80e7 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:30.845340 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4e1fca4b-a2d9-482b-a4b7-2821191f80e7 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:30.846104 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4e1fca4b-a2d9-482b-a4b7-2821191f80e7 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:30.849556 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4e1fca4b-a2d9-482b-a4b7-2821191f80e7 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:30.875626 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-4e1fca4b-a2d9-482b-a4b7-2821191f80e7 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 48c34b54-0234-4763-a6c1-f73c3c075277] Going to try to terminate instance {{(pid=124432) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 20:42:30.951822 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-4e1fca4b-a2d9-482b-a4b7-2821191f80e7 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "DELETE /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277" status: 204 len: 0 microversion: 2.1 time: 0.116848 Jul 15 20:42:30.952652 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 368/736] 10.222.0.66 () {58 vars in 1238 bytes} [Fri Jul 15 20:42:30 2022] DELETE /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 20:42:30.961053 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-903fcfff-7768-455f-b5e3-6cbed1051f77 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:30.961680 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-903fcfff-7768-455f-b5e3-6cbed1051f77 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 48c34b54-0234-4763-a6c1-f73c3c075277] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:30.968654 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-903fcfff-7768-455f-b5e3-6cbed1051f77 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:30.969103 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-903fcfff-7768-455f-b5e3-6cbed1051f77 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:30.969856 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-903fcfff-7768-455f-b5e3-6cbed1051f77 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:30.970284 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-903fcfff-7768-455f-b5e3-6cbed1051f77 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:31.109679 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-903fcfff-7768-455f-b5e3-6cbed1051f77 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:42:31.117516 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-903fcfff-7768-455f-b5e3-6cbed1051f77 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277" status: 200 len: 1522 microversion: 2.1 time: 0.160378 Jul 15 20:42:31.118082 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 369/737] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:42:30 2022] GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:42:31.699432 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-f814bf73-787d-44f6-a19a-84dab1848db4 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:31.700734 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-f814bf73-787d-44f6-a19a-84dab1848db4 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:31.707342 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f814bf73-787d-44f6-a19a-84dab1848db4 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:31.707830 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f814bf73-787d-44f6-a19a-84dab1848db4 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:31.708621 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f814bf73-787d-44f6-a19a-84dab1848db4 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:31.709056 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f814bf73-787d-44f6-a19a-84dab1848db4 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:31.843622 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-f814bf73-787d-44f6-a19a-84dab1848db4 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d12a685d9b419fa3606b5f4d1309fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af209f962144de4ae7e3575a3890096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:42:31.851117 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-f814bf73-787d-44f6-a19a-84dab1848db4 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e" status: 200 len: 1671 microversion: 2.1 time: 0.155968 Jul 15 20:42:31.851700 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 369/738] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:42:31 2022] GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e => generated 1671 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:42:32.135130 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-06d37ae0-aaf8-4ea3-b288-bd3600c56540 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:32.135767 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-06d37ae0-aaf8-4ea3-b288-bd3600c56540 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 48c34b54-0234-4763-a6c1-f73c3c075277] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:32.143047 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-06d37ae0-aaf8-4ea3-b288-bd3600c56540 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:32.143492 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-06d37ae0-aaf8-4ea3-b288-bd3600c56540 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:32.144245 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-06d37ae0-aaf8-4ea3-b288-bd3600c56540 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:32.144706 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-06d37ae0-aaf8-4ea3-b288-bd3600c56540 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:32.277251 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-06d37ae0-aaf8-4ea3-b288-bd3600c56540 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:42:32.285235 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-06d37ae0-aaf8-4ea3-b288-bd3600c56540 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277" status: 200 len: 1522 microversion: 2.1 time: 0.153806 Jul 15 20:42:32.285840 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 370/739] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:42:32 2022] GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:42:32.868580 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-d89edce8-cfcf-468e-a16e-780cf8eb0a9f tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:32.869123 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-d89edce8-cfcf-468e-a16e-780cf8eb0a9f tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:32.875646 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d89edce8-cfcf-468e-a16e-780cf8eb0a9f tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:32.876085 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d89edce8-cfcf-468e-a16e-780cf8eb0a9f tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:32.876865 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d89edce8-cfcf-468e-a16e-780cf8eb0a9f tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:32.877290 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d89edce8-cfcf-468e-a16e-780cf8eb0a9f tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:33.005843 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-d89edce8-cfcf-468e-a16e-780cf8eb0a9f tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d12a685d9b419fa3606b5f4d1309fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af209f962144de4ae7e3575a3890096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:42:33.013416 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-d89edce8-cfcf-468e-a16e-780cf8eb0a9f tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e" status: 200 len: 1671 microversion: 2.1 time: 0.148966 Jul 15 20:42:33.013972 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 370/740] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:42:32 2022] GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e => generated 1671 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:42:33.303775 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-c1e14933-9fa8-4a64-b0b1-dc0d1f052351 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:33.304375 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-c1e14933-9fa8-4a64-b0b1-dc0d1f052351 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 48c34b54-0234-4763-a6c1-f73c3c075277] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:33.310998 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c1e14933-9fa8-4a64-b0b1-dc0d1f052351 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:33.311441 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c1e14933-9fa8-4a64-b0b1-dc0d1f052351 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:33.312190 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c1e14933-9fa8-4a64-b0b1-dc0d1f052351 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:33.312646 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c1e14933-9fa8-4a64-b0b1-dc0d1f052351 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:33.441857 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-c1e14933-9fa8-4a64-b0b1-dc0d1f052351 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:42:33.445402 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:42:33.450143 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-c1e14933-9fa8-4a64-b0b1-dc0d1f052351 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277" status: 200 len: 1522 microversion: 2.1 time: 0.150214 Jul 15 20:42:33.450701 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 371/741] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:42:33 2022] GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:42:34.030876 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-3c6ff4a4-2c82-46d0-adda-81ff1ae8852d tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:34.031486 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-3c6ff4a4-2c82-46d0-adda-81ff1ae8852d tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:34.038030 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3c6ff4a4-2c82-46d0-adda-81ff1ae8852d tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:34.038480 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3c6ff4a4-2c82-46d0-adda-81ff1ae8852d tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:34.039244 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3c6ff4a4-2c82-46d0-adda-81ff1ae8852d tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:34.039681 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3c6ff4a4-2c82-46d0-adda-81ff1ae8852d tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:34.171922 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-3c6ff4a4-2c82-46d0-adda-81ff1ae8852d tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d12a685d9b419fa3606b5f4d1309fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af209f962144de4ae7e3575a3890096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:42:34.174420 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:42:34.181024 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-3c6ff4a4-2c82-46d0-adda-81ff1ae8852d tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e" status: 200 len: 1671 microversion: 2.1 time: 0.154521 Jul 15 20:42:34.181583 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 371/742] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:42:34 2022] GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e => generated 1671 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:42:34.468478 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-d1325c4f-8634-46a1-b660-48050c0da067 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:34.469090 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-d1325c4f-8634-46a1-b660-48050c0da067 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 48c34b54-0234-4763-a6c1-f73c3c075277] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:34.477612 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d1325c4f-8634-46a1-b660-48050c0da067 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:34.478063 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d1325c4f-8634-46a1-b660-48050c0da067 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:34.478878 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d1325c4f-8634-46a1-b660-48050c0da067 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:34.479355 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d1325c4f-8634-46a1-b660-48050c0da067 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:34.607401 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-d1325c4f-8634-46a1-b660-48050c0da067 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:42:34.614592 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-d1325c4f-8634-46a1-b660-48050c0da067 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277" status: 200 len: 1522 microversion: 2.1 time: 0.151689 Jul 15 20:42:34.615151 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 372/743] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:42:34 2022] GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:42:35.198255 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-b0e41075-57b3-4062-9776-1ce016d757d5 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:35.198871 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-b0e41075-57b3-4062-9776-1ce016d757d5 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:35.206420 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b0e41075-57b3-4062-9776-1ce016d757d5 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:35.206868 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b0e41075-57b3-4062-9776-1ce016d757d5 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:35.207678 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b0e41075-57b3-4062-9776-1ce016d757d5 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:35.208109 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b0e41075-57b3-4062-9776-1ce016d757d5 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:35.343205 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-b0e41075-57b3-4062-9776-1ce016d757d5 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d12a685d9b419fa3606b5f4d1309fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af209f962144de4ae7e3575a3890096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:42:35.351335 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-b0e41075-57b3-4062-9776-1ce016d757d5 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e" status: 200 len: 1671 microversion: 2.1 time: 0.157010 Jul 15 20:42:35.351907 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 372/744] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:42:35 2022] GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e => generated 1671 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:42:35.631658 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-e17779ba-a172-41c9-809f-8c8c7dc871ec tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:35.632292 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-e17779ba-a172-41c9-809f-8c8c7dc871ec tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 48c34b54-0234-4763-a6c1-f73c3c075277] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:35.639754 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e17779ba-a172-41c9-809f-8c8c7dc871ec tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:35.640215 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e17779ba-a172-41c9-809f-8c8c7dc871ec tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:35.641081 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e17779ba-a172-41c9-809f-8c8c7dc871ec tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:35.641521 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e17779ba-a172-41c9-809f-8c8c7dc871ec tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:35.784511 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-e17779ba-a172-41c9-809f-8c8c7dc871ec tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13d5d7068e348248387b512c55dec5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0395d91380b34e968d7e39be3bc88b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:42:35.794031 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-e17779ba-a172-41c9-809f-8c8c7dc871ec tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277" status: 200 len: 1522 microversion: 2.1 time: 0.166333 Jul 15 20:42:35.794899 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 373/745] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:42:35 2022] GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:42:35.890000 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-faaf3dde-4abc-4e08-bca9-0bee5de2d99c req-f75c970d-bb47-4ce6-a6aa-8119b554fea7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48c34b54-0234-4763-a6c1-f73c3c075277", "name": "network-vif-deleted", "tag": "f430e1bb-7731-410f-ac4d-4f4b0b340704"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:42:35.898817 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-faaf3dde-4abc-4e08-bca9-0bee5de2d99c req-f75c970d-bb47-4ce6-a6aa-8119b554fea7 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:35.899264 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-faaf3dde-4abc-4e08-bca9-0bee5de2d99c req-f75c970d-bb47-4ce6-a6aa-8119b554fea7 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:35.911444 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-faaf3dde-4abc-4e08-bca9-0bee5de2d99c req-f75c970d-bb47-4ce6-a6aa-8119b554fea7 service nova] Creating event network-vif-deleted:f430e1bb-7731-410f-ac4d-4f4b0b340704 for instance 48c34b54-0234-4763-a6c1-f73c3c075277 on hv-cinder-79987 Jul 15 20:42:35.918716 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-faaf3dde-4abc-4e08-bca9-0bee5de2d99c req-f75c970d-bb47-4ce6-a6aa-8119b554fea7 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033257 Jul 15 20:42:35.920373 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 373/746] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:42:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:42:36.373507 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-aaea5f55-8d66-48b9-8c53-48c7ff6448a9 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:36.374806 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-aaea5f55-8d66-48b9-8c53-48c7ff6448a9 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:36.395508 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-aaea5f55-8d66-48b9-8c53-48c7ff6448a9 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:36.396254 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-aaea5f55-8d66-48b9-8c53-48c7ff6448a9 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:36.405463 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-aaea5f55-8d66-48b9-8c53-48c7ff6448a9 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:36.407154 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-aaea5f55-8d66-48b9-8c53-48c7ff6448a9 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:36.503453 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-aaea5f55-8d66-48b9-8c53-48c7ff6448a9 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d12a685d9b419fa3606b5f4d1309fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af209f962144de4ae7e3575a3890096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:42:36.511811 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-aaea5f55-8d66-48b9-8c53-48c7ff6448a9 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e" status: 200 len: 1604 microversion: 2.1 time: 0.146401 Jul 15 20:42:36.522865 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 374/747] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:42:36 2022] GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e => generated 1604 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:42:36.812531 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-6462a7d0-f972-4167-89f6-ec69d02ab015 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:36.813235 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-6462a7d0-f972-4167-89f6-ec69d02ab015 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] [instance: 48c34b54-0234-4763-a6c1-f73c3c075277] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:36.819477 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6462a7d0-f972-4167-89f6-ec69d02ab015 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:36.819927 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6462a7d0-f972-4167-89f6-ec69d02ab015 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:36.820728 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6462a7d0-f972-4167-89f6-ec69d02ab015 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:36.821166 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6462a7d0-f972-4167-89f6-ec69d02ab015 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:36.835331 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.wsgi [None req-6462a7d0-f972-4167-89f6-ec69d02ab015 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] HTTP exception thrown: Instance 48c34b54-0234-4763-a6c1-f73c3c075277 could not be found. Jul 15 20:42:36.837043 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-6462a7d0-f972-4167-89f6-ec69d02ab015 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Request method failure captured: Jul 15 20:42:36.837043 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: request: GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277 HTTP/1.1 Jul 15 20:42:36.837043 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Accept: application/json Jul 15 20:42:36.837043 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Accept-Encoding: identity Jul 15 20:42:36.837043 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Connection: close Jul 15 20:42:36.837043 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Content-Length: 0 Jul 15 20:42:36.837043 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Content-Type: application/json Jul 15 20:42:36.837043 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Host: 10.222.0.66 Jul 15 20:42:36.837043 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Openstack-System-Scope: None Jul 15 20:42:36.837043 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: User-Agent: python-urllib3/1.26.9 Jul 15 20:42:36.837043 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Auth-Token: gAAAAABi0c_lkbnVJwqH3IpbVZVWMQ8HLL8u6A1nS9xbrwR6NEMpzbfmtKxCTl345tuTNHTXVBkYUfn70H4FibX8wPsRThE1aLHTgYmYauzCicRFu1CJ8qFyi1jEF3aSJLDbXxeN4ZX8G4ZQcm6oZkgRw4bn00Q4s9ZTfchWhd2dhVKZ6EVvqgw Jul 15 20:42:36.837043 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Domain-Id: None Jul 15 20:42:36.837043 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Domain-Name: None Jul 15 20:42:36.837043 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Identity-Status: Confirmed Jul 15 20:42:36.837043 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Is-Admin-Project: True Jul 15 20:42:36.837043 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Domain-Id: default Jul 15 20:42:36.837043 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Domain-Name: Default Jul 15 20:42:36.837043 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Id: 0395d91380b34e968d7e39be3bc88b0f Jul 15 20:42:36.837043 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1747571758 Jul 15 20:42:36.837043 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Role: member,reader Jul 15 20:42:36.837043 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Roles: member,reader Jul 15 20:42:36.838618 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0395d91380b34e968d7e39be3bc88b0f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_0395d91380b34e968d7e39be3bc88b0f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0395d91380b34e968d7e39be3bc88b0f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/0395d91380b34e968d7e39be3bc88b0f"}]}] Jul 15 20:42:36.838618 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1747571758 Jul 15 20:42:36.838618 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Tenant-Id: 0395d91380b34e968d7e39be3bc88b0f Jul 15 20:42:36.838618 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1747571758 Jul 15 20:42:36.838618 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User: tempest-ServerRescueNegativeTestJSON-1747571758-project Jul 15 20:42:36.838618 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Domain-Id: default Jul 15 20:42:36.838618 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Domain-Name: Default Jul 15 20:42:36.838618 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Id: e13d5d7068e348248387b512c55dec5e Jul 15 20:42:36.838618 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1747571758-project Jul 15 20:42:36.838618 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: method: > Jul 15 20:42:36.838618 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: exception: Instance 48c34b54-0234-4763-a6c1-f73c3c075277 could not be found. Jul 15 20:42:36.838618 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: action_args: {'id': '48c34b54-0234-4763-a6c1-f73c3c075277'} Jul 15 20:42:36.839512 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 20:42:36.839512 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:42:36.839512 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 20:42:36.839512 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 20:42:36.839512 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 20:42:36.839512 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 20:42:36.839512 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 20:42:36.839512 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 20:42:36.839512 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 20:42:36.839512 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 20:42:36.839512 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48c34b54-0234-4763-a6c1-f73c3c075277 could not be found. Jul 15 20:42:36.839512 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:42:36.839512 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:42:36.839512 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:42:36.839512 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:42:36.839512 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:42:36.839512 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:42:36.839512 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 20:42:36.839512 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 20:42:36.839512 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 20:42:36.841874 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 20:42:36.841874 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 20:42:36.841874 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 20:42:36.841874 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 20:42:36.841874 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 20:42:36.841874 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 20:42:36.841874 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 20:42:36.841874 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48c34b54-0234-4763-a6c1-f73c3c075277 could not be found. Jul 15 20:42:36.841874 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:42:36.841874 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:42:36.841874 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:42:36.841874 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:42:36.841874 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:42:36.841874 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:42:36.841874 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 20:42:36.841874 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 20:42:36.841874 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48c34b54-0234-4763-a6c1-f73c3c075277 could not be found. Jul 15 20:42:36.841874 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:42:36.843169 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-6462a7d0-f972-4167-89f6-ec69d02ab015 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] Returning 404 to user: Instance 48c34b54-0234-4763-a6c1-f73c3c075277 could not be found. {{(pid=124432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 20:42:36.843169 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-6462a7d0-f972-4167-89f6-ec69d02ab015 tempest-ServerRescueNegativeTestJSON-1747571758 tempest-ServerRescueNegativeTestJSON-1747571758-project] 10.222.0.66 "GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277" status: 404 len: 111 microversion: 2.1 time: 0.031117 Jul 15 20:42:36.843169 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 374/748] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:42:36 2022] GET /compute/v2.1/servers/48c34b54-0234-4763-a6c1-f73c3c075277 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 20:42:37.530712 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-2c887ace-7ea6-45bb-a38f-86219984dc82 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:37.531335 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-2c887ace-7ea6-45bb-a38f-86219984dc82 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:37.537910 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-2c887ace-7ea6-45bb-a38f-86219984dc82 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:37.538371 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-2c887ace-7ea6-45bb-a38f-86219984dc82 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:37.539151 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-2c887ace-7ea6-45bb-a38f-86219984dc82 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:37.539594 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-2c887ace-7ea6-45bb-a38f-86219984dc82 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:37.554397 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.wsgi [None req-2c887ace-7ea6-45bb-a38f-86219984dc82 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] HTTP exception thrown: Instance 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e could not be found. Jul 15 20:42:37.555938 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-2c887ace-7ea6-45bb-a38f-86219984dc82 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Request method failure captured: Jul 15 20:42:37.555938 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: request: GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e HTTP/1.1 Jul 15 20:42:37.555938 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Accept: application/json Jul 15 20:42:37.555938 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Accept-Encoding: identity Jul 15 20:42:37.555938 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Connection: close Jul 15 20:42:37.555938 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Content-Length: 0 Jul 15 20:42:37.555938 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Content-Type: application/json Jul 15 20:42:37.555938 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Host: 10.222.0.66 Jul 15 20:42:37.555938 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Openstack-System-Scope: None Jul 15 20:42:37.555938 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: User-Agent: python-urllib3/1.26.9 Jul 15 20:42:37.555938 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Auth-Token: gAAAAABi0dBEFjFrdM-t1qn2GVlnIzLFPzEiMCH376b_bq8y8sAU95pWU5rp8WQ4Pzq9aTBnJ2670jBZzG_1C1hPpW20abHkue1szruQ7QW9zRDMObf8WqD4Ko1amQUqwrnk9woNQQT1EHUnoNbLh_TGl4IWhyGUHaJEpKT3PlNLBZc2iT-X8Mk Jul 15 20:42:37.555938 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Domain-Id: None Jul 15 20:42:37.555938 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Domain-Name: None Jul 15 20:42:37.555938 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Identity-Status: Confirmed Jul 15 20:42:37.555938 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Is-Admin-Project: True Jul 15 20:42:37.555938 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Domain-Id: default Jul 15 20:42:37.555938 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Domain-Name: Default Jul 15 20:42:37.555938 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Id: 9af209f962144de4ae7e3575a3890096 Jul 15 20:42:37.555938 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Name: tempest-AttachVolumeTestJSON-1635157670 Jul 15 20:42:37.555938 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Role: member,reader Jul 15 20:42:37.555938 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Roles: member,reader Jul 15 20:42:37.557530 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9af209f962144de4ae7e3575a3890096"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9af209f962144de4ae7e3575a3890096"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9af209f962144de4ae7e3575a3890096"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9af209f962144de4ae7e3575a3890096"}]}] Jul 15 20:42:37.557530 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant: tempest-AttachVolumeTestJSON-1635157670 Jul 15 20:42:37.557530 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant-Id: 9af209f962144de4ae7e3575a3890096 Jul 15 20:42:37.557530 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1635157670 Jul 15 20:42:37.557530 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User: tempest-AttachVolumeTestJSON-1635157670-project Jul 15 20:42:37.557530 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Domain-Id: default Jul 15 20:42:37.557530 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Domain-Name: Default Jul 15 20:42:37.557530 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Id: 75d12a685d9b419fa3606b5f4d1309fe Jul 15 20:42:37.557530 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Name: tempest-AttachVolumeTestJSON-1635157670-project Jul 15 20:42:37.557530 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: method: > Jul 15 20:42:37.557530 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: exception: Instance 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e could not be found. Jul 15 20:42:37.557530 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: action_args: {'id': '5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e'} Jul 15 20:42:37.558423 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 20:42:37.558423 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:42:37.558423 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 20:42:37.558423 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 20:42:37.558423 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 20:42:37.558423 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 20:42:37.558423 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 20:42:37.558423 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 20:42:37.558423 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 20:42:37.558423 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 20:42:37.558423 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e could not be found. Jul 15 20:42:37.558423 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:42:37.558423 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:42:37.558423 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:42:37.558423 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:42:37.558423 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:42:37.558423 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:42:37.558423 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 20:42:37.558423 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 20:42:37.558423 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 20:42:37.560423 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 20:42:37.560423 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 20:42:37.560423 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 20:42:37.560423 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 20:42:37.560423 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 20:42:37.560423 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 20:42:37.560423 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 20:42:37.560423 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e could not be found. Jul 15 20:42:37.560423 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:42:37.560423 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:42:37.560423 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:42:37.560423 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:42:37.560423 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:42:37.560423 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:42:37.560423 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 20:42:37.560423 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 20:42:37.560423 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e could not be found. Jul 15 20:42:37.560423 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:42:37.562043 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-2c887ace-7ea6-45bb-a38f-86219984dc82 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Returning 404 to user: Instance 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e could not be found. {{(pid=124430) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 20:42:37.562043 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-2c887ace-7ea6-45bb-a38f-86219984dc82 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e" status: 404 len: 111 microversion: 2.1 time: 0.030854 Jul 15 20:42:37.562043 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 375/749] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:42:37 2022] GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 20:42:37.567222 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-994d32cf-a47c-48c3-923e-df8408e5f1f2 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '.version_select at 0x7ff51826c670>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:37.578905 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=4,nova_api:DELETE=2 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:42:37.587983 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-994d32cf-a47c-48c3-923e-df8408e5f1f2 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-211388367" status: 202 len: 0 microversion: 2.1 time: 0.024540 Jul 15 20:42:37.588867 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 375/750] 10.222.0.66 () {58 vars in 1217 bytes} [Fri Jul 15 20:42:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-211388367 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 20:42:37.935271 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [req-5c27531a-9d9d-48e1-b53a-d72d8b722d09 req-27762190-ef85-40c2-9c51-004cef55fbc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e", "name": "network-vif-deleted", "tag": "a159b185-0579-4cd7-b4de-9e9d9f79f9a8"}]} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:42:37.943533 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-5c27531a-9d9d-48e1-b53a-d72d8b722d09 req-27762190-ef85-40c2-9c51-004cef55fbc5 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:37.943962 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-5c27531a-9d9d-48e1-b53a-d72d8b722d09 req-27762190-ef85-40c2-9c51-004cef55fbc5 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:37.955082 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.compute.server_external_events [req-5c27531a-9d9d-48e1-b53a-d72d8b722d09 req-27762190-ef85-40c2-9c51-004cef55fbc5 service nova] Creating event network-vif-deleted:a159b185-0579-4cd7-b4de-9e9d9f79f9a8 for instance 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e on hv-cinder-79987 Jul 15 20:42:37.960191 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [req-5c27531a-9d9d-48e1-b53a-d72d8b722d09 req-27762190-ef85-40c2-9c51-004cef55fbc5 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028797 Jul 15 20:42:37.960797 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 376/751] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:42:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:42:38.592664 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-7c31afee-ddb6-495a-aa1b-81fb17070b10 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Action: 'create', calling method: .version_select at 0x7ff518041280>, body: {"keypair": {"name": "tempest-keypair-1471088480", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLBMIOSbwZIBNqJcM58DGLzO4giFn/R16nZaGZie2R8DU/mqaApWXY94BV46RVEMiIpSDe3p9Psu623IciQpV0gVNQPA2s/He3Og2NQGzXhkQIQsu0ghmqzf5EasNw0EJg=="}} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:42:38.608070 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-7c31afee-ddb6-495a-aa1b-81fb17070b10 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Getting quotas for project 9af209f962144de4ae7e3575a3890096. Resources: {'key_pairs'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 20:42:38.611892 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-7c31afee-ddb6-495a-aa1b-81fb17070b10 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Getting quotas for user 75d12a685d9b419fa3606b5f4d1309fe and project 9af209f962144de4ae7e3575a3890096. Resources: {'key_pairs'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 20:42:38.634209 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-7c31afee-ddb6-495a-aa1b-81fb17070b10 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047376 Jul 15 20:42:38.634981 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 376/752] 10.222.0.66 () {60 vars in 1158 bytes} [Fri Jul 15 20:42:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:42:40.686651 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-8bbb6b7f-4c2e-4217-ae8a-9770fe7e4f14 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1739620359", "imageRef": "a759604a-67e3-4c79-b848-5d03d936d7a0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2ff4648d-db69-4beb-a549-03dce5a885bc"}], "security_groups": [{"name": "tempest-securitygroup--1840986055"}], "key_name": "tempest-keypair-1471088480", "user_data": "}} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:42:40.842290 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.network.neutron [None req-8bbb6b7f-4c2e-4217-ae8a-9770fe7e4f14 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] validate_networks() for [('2ff4648d-db69-4beb-a549-03dce5a885bc', None, None, None, None, None)] {{(pid=124430) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 20:42:41.689242 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.virt.hardware [None req-8bbb6b7f-4c2e-4217-ae8a-9770fe7e4f14 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Flavor limits 0:0:0 {{(pid=124430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 20:42:41.689863 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.virt.hardware [None req-8bbb6b7f-4c2e-4217-ae8a-9770fe7e4f14 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Image limits 0:0:0 {{(pid=124430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 20:42:41.690126 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.virt.hardware [None req-8bbb6b7f-4c2e-4217-ae8a-9770fe7e4f14 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Flavor pref 0:0:0 {{(pid=124430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 20:42:41.691021 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.virt.hardware [None req-8bbb6b7f-4c2e-4217-ae8a-9770fe7e4f14 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Image pref 0:0:0 {{(pid=124430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 20:42:41.691426 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.virt.hardware [None req-8bbb6b7f-4c2e-4217-ae8a-9770fe7e4f14 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 20:42:41.701163 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8bbb6b7f-4c2e-4217-ae8a-9770fe7e4f14 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:41.701614 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8bbb6b7f-4c2e-4217-ae8a-9770fe7e4f14 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:41.702430 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8bbb6b7f-4c2e-4217-ae8a-9770fe7e4f14 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:41.702864 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8bbb6b7f-4c2e-4217-ae8a-9770fe7e4f14 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:41.720161 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.quota [None req-8bbb6b7f-4c2e-4217-ae8a-9770fe7e4f14 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Getting quotas for project 9af209f962144de4ae7e3575a3890096. Resources: {'instances', 'ram', 'cores'} {{(pid=124430) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 20:42:41.725086 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.quota [None req-8bbb6b7f-4c2e-4217-ae8a-9770fe7e4f14 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Getting quotas for user 75d12a685d9b419fa3606b5f4d1309fe and project 9af209f962144de4ae7e3575a3890096. Resources: {'instances', 'ram', 'cores'} {{(pid=124430) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 20:42:41.737156 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-8bbb6b7f-4c2e-4217-ae8a-9770fe7e4f14 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Going to run 1 instances... {{(pid=124430) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 20:42:41.740079 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-8bbb6b7f-4c2e-4217-ae8a-9770fe7e4f14 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 0b11cb14-b513-4341-a418-ddf26c9e464e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a759604a-67e3-4c79-b848-5d03d936d7a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124430) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 20:42:41.786832 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-8bbb6b7f-4c2e-4217-ae8a-9770fe7e4f14 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.105396 Jul 15 20:42:41.787612 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 377/753] 10.222.0.66 () {60 vars in 1146 bytes} [Fri Jul 15 20:42:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 1107 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 20:42:41.799017 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-ad6444ed-9311-4aaa-9711-bbe4b3cfdca0 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:41.799622 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-ad6444ed-9311-4aaa-9711-bbe4b3cfdca0 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 0b11cb14-b513-4341-a418-ddf26c9e464e] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:41.857940 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-ad6444ed-9311-4aaa-9711-bbe4b3cfdca0 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d12a685d9b419fa3606b5f4d1309fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af209f962144de4ae7e3575a3890096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:42:41.867646 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-ad6444ed-9311-4aaa-9711-bbe4b3cfdca0 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/0b11cb14-b513-4341-a418-ddf26c9e464e" status: 200 len: 1238 microversion: 2.1 time: 0.073085 Jul 15 20:42:41.868209 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 377/754] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:42:41 2022] GET /compute/v2.1/servers/0b11cb14-b513-4341-a418-ddf26c9e464e => generated 1238 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:42:42.885219 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-86089fb4-f7d4-4c6d-b8d0-12b68c210b3d tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:42.885893 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-86089fb4-f7d4-4c6d-b8d0-12b68c210b3d tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 0b11cb14-b513-4341-a418-ddf26c9e464e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:42.893307 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-86089fb4-f7d4-4c6d-b8d0-12b68c210b3d tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:42.893746 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-86089fb4-f7d4-4c6d-b8d0-12b68c210b3d tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:42.894714 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-86089fb4-f7d4-4c6d-b8d0-12b68c210b3d tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:42.895305 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-86089fb4-f7d4-4c6d-b8d0-12b68c210b3d tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:43.001438 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-86089fb4-f7d4-4c6d-b8d0-12b68c210b3d tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d12a685d9b419fa3606b5f4d1309fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af209f962144de4ae7e3575a3890096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:42:43.020840 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-86089fb4-f7d4-4c6d-b8d0-12b68c210b3d tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/0b11cb14-b513-4341-a418-ddf26c9e464e" status: 200 len: 1308 microversion: 2.1 time: 0.139902 Jul 15 20:42:43.021628 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 378/755] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:42:42 2022] GET /compute/v2.1/servers/0b11cb14-b513-4341-a418-ddf26c9e464e => generated 1308 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:42:44.038170 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-225b836a-ac85-43b8-8f4a-21b78b85f263 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:44.039741 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-225b836a-ac85-43b8-8f4a-21b78b85f263 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 0b11cb14-b513-4341-a418-ddf26c9e464e] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:44.048606 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-225b836a-ac85-43b8-8f4a-21b78b85f263 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:44.049297 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-225b836a-ac85-43b8-8f4a-21b78b85f263 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:44.050069 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-225b836a-ac85-43b8-8f4a-21b78b85f263 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:44.050509 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-225b836a-ac85-43b8-8f4a-21b78b85f263 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:44.212881 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-225b836a-ac85-43b8-8f4a-21b78b85f263 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d12a685d9b419fa3606b5f4d1309fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af209f962144de4ae7e3575a3890096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:42:44.222087 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-225b836a-ac85-43b8-8f4a-21b78b85f263 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/0b11cb14-b513-4341-a418-ddf26c9e464e" status: 200 len: 1364 microversion: 2.1 time: 0.187925 Jul 15 20:42:44.222665 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 378/756] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:42:44 2022] GET /compute/v2.1/servers/0b11cb14-b513-4341-a418-ddf26c9e464e => generated 1364 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:42:45.239978 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-9d7e8de5-109e-4f43-b12b-79e195ab6db7 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:45.240642 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-9d7e8de5-109e-4f43-b12b-79e195ab6db7 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 0b11cb14-b513-4341-a418-ddf26c9e464e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:45.248146 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-9d7e8de5-109e-4f43-b12b-79e195ab6db7 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:45.248619 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-9d7e8de5-109e-4f43-b12b-79e195ab6db7 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:45.249393 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-9d7e8de5-109e-4f43-b12b-79e195ab6db7 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:45.249825 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-9d7e8de5-109e-4f43-b12b-79e195ab6db7 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:45.389050 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-9d7e8de5-109e-4f43-b12b-79e195ab6db7 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d12a685d9b419fa3606b5f4d1309fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af209f962144de4ae7e3575a3890096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:42:45.400850 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-9d7e8de5-109e-4f43-b12b-79e195ab6db7 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/0b11cb14-b513-4341-a418-ddf26c9e464e" status: 200 len: 1364 microversion: 2.1 time: 0.164788 Jul 15 20:42:45.401427 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 379/757] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:42:45 2022] GET /compute/v2.1/servers/0b11cb14-b513-4341-a418-ddf26c9e464e => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:42:45.634583 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-9a65c84f-d966-4faa-9c24-f377c0b026b4 req-bf0ca410-cc19-432d-bc0e-34e5caab4610 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b11cb14-b513-4341-a418-ddf26c9e464e", "tag": "ee939cda-b869-4fbe-96c0-c0ea588ff114"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:42:45.645593 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-9a65c84f-d966-4faa-9c24-f377c0b026b4 req-bf0ca410-cc19-432d-bc0e-34e5caab4610 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:45.645825 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-9a65c84f-d966-4faa-9c24-f377c0b026b4 req-bf0ca410-cc19-432d-bc0e-34e5caab4610 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:45.663011 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-9a65c84f-d966-4faa-9c24-f377c0b026b4 req-bf0ca410-cc19-432d-bc0e-34e5caab4610 service nova] Creating event network-changed:ee939cda-b869-4fbe-96c0-c0ea588ff114 for instance 0b11cb14-b513-4341-a418-ddf26c9e464e on hv-cinder-79987 Jul 15 20:42:45.668757 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-9a65c84f-d966-4faa-9c24-f377c0b026b4 req-bf0ca410-cc19-432d-bc0e-34e5caab4610 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044423 Jul 15 20:42:45.669907 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 379/758] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:42:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:42:46.418345 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-e1dfedd2-c78f-4086-b969-fc22adea80b6 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:46.418996 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-e1dfedd2-c78f-4086-b969-fc22adea80b6 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 0b11cb14-b513-4341-a418-ddf26c9e464e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:46.421752 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:42:46.427499 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e1dfedd2-c78f-4086-b969-fc22adea80b6 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:46.427950 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e1dfedd2-c78f-4086-b969-fc22adea80b6 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:46.428922 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e1dfedd2-c78f-4086-b969-fc22adea80b6 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:46.429515 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e1dfedd2-c78f-4086-b969-fc22adea80b6 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:46.663089 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-e1dfedd2-c78f-4086-b969-fc22adea80b6 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d12a685d9b419fa3606b5f4d1309fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af209f962144de4ae7e3575a3890096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:42:46.671651 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-e1dfedd2-c78f-4086-b969-fc22adea80b6 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/0b11cb14-b513-4341-a418-ddf26c9e464e" status: 200 len: 1364 microversion: 2.1 time: 0.257742 Jul 15 20:42:46.672222 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 380/759] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:42:46 2022] GET /compute/v2.1/servers/0b11cb14-b513-4341-a418-ddf26c9e464e => generated 1364 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:42:47.695470 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-f69e691b-7127-43a3-a5f1-f28444b71d3c tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:47.698922 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-f69e691b-7127-43a3-a5f1-f28444b71d3c tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 0b11cb14-b513-4341-a418-ddf26c9e464e] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:47.710795 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f69e691b-7127-43a3-a5f1-f28444b71d3c tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:47.711599 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f69e691b-7127-43a3-a5f1-f28444b71d3c tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:47.712949 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f69e691b-7127-43a3-a5f1-f28444b71d3c tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:47.713611 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f69e691b-7127-43a3-a5f1-f28444b71d3c tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:47.909409 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-f69e691b-7127-43a3-a5f1-f28444b71d3c tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d12a685d9b419fa3606b5f4d1309fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af209f962144de4ae7e3575a3890096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:42:47.918586 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-f69e691b-7127-43a3-a5f1-f28444b71d3c tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/0b11cb14-b513-4341-a418-ddf26c9e464e" status: 200 len: 1364 microversion: 2.1 time: 0.232737 Jul 15 20:42:47.928265 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 380/760] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:42:47 2022] GET /compute/v2.1/servers/0b11cb14-b513-4341-a418-ddf26c9e464e => generated 1364 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:42:47.988414 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-1ab81f00-334c-4d75-9172-5bbe76387415 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Action: 'create', calling method: .version_select at 0x7ff5181949d0>, body: {"keypair": {"name": "tempest-keypair-1703490576", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNSFotxms0JFDhRPU0BzDprpPfaUlDcd9luge6unlIZvHq6NYQtt1/TnH+TBnw1dC5PFEiquKEvPbHcmsR2pW4+3BZpIjrtrQTe90lm+TrivAlS7D5HZ/4dCZCRwbe8/cg=="}} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:42:48.003952 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.quota [None req-1ab81f00-334c-4d75-9172-5bbe76387415 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Getting quotas for project f852483a41394ef699c09ccee827fa28. Resources: {'key_pairs'} {{(pid=124430) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 20:42:48.008066 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.quota [None req-1ab81f00-334c-4d75-9172-5bbe76387415 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Getting quotas for user fbe7070e9384403ca998a996e8dd6b50 and project f852483a41394ef699c09ccee827fa28. Resources: {'key_pairs'} {{(pid=124430) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 20:42:48.033793 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-1ab81f00-334c-4d75-9172-5bbe76387415 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.182243 Jul 15 20:42:48.039596 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 381/761] 10.222.0.66 () {62 vars in 1199 bytes} [Fri Jul 15 20:42:47 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 184 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 15 20:42:48.935511 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-00312500-af64-4423-b3ee-d7bd2925fb68 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:48.936263 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-00312500-af64-4423-b3ee-d7bd2925fb68 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 0b11cb14-b513-4341-a418-ddf26c9e464e] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:48.943682 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-00312500-af64-4423-b3ee-d7bd2925fb68 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:48.946287 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-00312500-af64-4423-b3ee-d7bd2925fb68 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:48.947329 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-00312500-af64-4423-b3ee-d7bd2925fb68 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:48.953309 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-00312500-af64-4423-b3ee-d7bd2925fb68 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:49.100629 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-00312500-af64-4423-b3ee-d7bd2925fb68 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d12a685d9b419fa3606b5f4d1309fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af209f962144de4ae7e3575a3890096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:42:49.109919 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-00312500-af64-4423-b3ee-d7bd2925fb68 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/0b11cb14-b513-4341-a418-ddf26c9e464e" status: 200 len: 1364 microversion: 2.1 time: 0.178718 Jul 15 20:42:49.110497 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 381/762] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:42:48 2022] GET /compute/v2.1/servers/0b11cb14-b513-4341-a418-ddf26c9e464e => generated 1364 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:42:49.475167 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-95936ab5-9fa6-4061-93a7-5efb09b9cb14 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-39524315", "imageRef": "a759604a-67e3-4c79-b848-5d03d936d7a0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ceb697eb-c07c-4de1-8715-3ceb0ba4658d"}], "security_groups": [{"name": "tempest-securitygroup--1324105847"}], "key_name": "tempest-keypair-1703490576", "user_data": "}} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:42:49.578329 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.network.neutron [None req-95936ab5-9fa6-4061-93a7-5efb09b9cb14 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] validate_networks() for [('ceb697eb-c07c-4de1-8715-3ceb0ba4658d', None, None, None, None, None)] {{(pid=124430) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 20:42:49.951581 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.virt.hardware [None req-95936ab5-9fa6-4061-93a7-5efb09b9cb14 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Flavor limits 0:0:0 {{(pid=124430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 20:42:49.952061 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.virt.hardware [None req-95936ab5-9fa6-4061-93a7-5efb09b9cb14 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Image limits 0:0:0 {{(pid=124430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 20:42:49.952644 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.virt.hardware [None req-95936ab5-9fa6-4061-93a7-5efb09b9cb14 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Flavor pref 0:0:0 {{(pid=124430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 20:42:49.953106 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.virt.hardware [None req-95936ab5-9fa6-4061-93a7-5efb09b9cb14 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Image pref 0:0:0 {{(pid=124430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 20:42:49.953577 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.virt.hardware [None req-95936ab5-9fa6-4061-93a7-5efb09b9cb14 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 20:42:49.962606 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-95936ab5-9fa6-4061-93a7-5efb09b9cb14 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:49.963373 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-95936ab5-9fa6-4061-93a7-5efb09b9cb14 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:49.964185 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-95936ab5-9fa6-4061-93a7-5efb09b9cb14 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:49.964791 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-95936ab5-9fa6-4061-93a7-5efb09b9cb14 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:49.981784 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.quota [None req-95936ab5-9fa6-4061-93a7-5efb09b9cb14 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Getting quotas for project f852483a41394ef699c09ccee827fa28. Resources: {'instances', 'ram', 'cores'} {{(pid=124430) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 20:42:49.985570 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.quota [None req-95936ab5-9fa6-4061-93a7-5efb09b9cb14 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Getting quotas for user fbe7070e9384403ca998a996e8dd6b50 and project f852483a41394ef699c09ccee827fa28. Resources: {'instances', 'ram', 'cores'} {{(pid=124430) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 20:42:49.996632 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-95936ab5-9fa6-4061-93a7-5efb09b9cb14 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Going to run 1 instances... {{(pid=124430) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 20:42:49.999062 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-95936ab5-9fa6-4061-93a7-5efb09b9cb14 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 526626a0-8b46-4f4a-9371-4b310ac67640] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a759604a-67e3-4c79-b848-5d03d936d7a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124430) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 20:42:50.045314 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-95936ab5-9fa6-4061-93a7-5efb09b9cb14 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.574867 Jul 15 20:42:50.048530 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 382/763] 10.222.0.66 () {62 vars in 1187 bytes} [Fri Jul 15 20:42:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 579 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 15 20:42:50.055927 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-3f04f34f-a0e3-480f-bf05-8df4db2222ff tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:50.056556 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-3f04f34f-a0e3-480f-bf05-8df4db2222ff tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 526626a0-8b46-4f4a-9371-4b310ac67640] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:50.122530 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-3f04f34f-a0e3-480f-bf05-8df4db2222ff tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:42:50.128557 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-b1d77193-00d2-4e38-bbf4-22d0cdf7cbef tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:50.129543 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-b1d77193-00d2-4e38-bbf4-22d0cdf7cbef tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 0b11cb14-b513-4341-a418-ddf26c9e464e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:50.130863 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-3f04f34f-a0e3-480f-bf05-8df4db2222ff tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:42:50.132887 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-3f04f34f-a0e3-480f-bf05-8df4db2222ff tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:42:50.133875 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-3f04f34f-a0e3-480f-bf05-8df4db2222ff tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640" status: 200 len: 1280 microversion: 2.20 time: 0.081843 Jul 15 20:42:50.137314 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b1d77193-00d2-4e38-bbf4-22d0cdf7cbef tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:50.138199 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b1d77193-00d2-4e38-bbf4-22d0cdf7cbef tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:50.139820 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b1d77193-00d2-4e38-bbf4-22d0cdf7cbef tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:50.140700 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b1d77193-00d2-4e38-bbf4-22d0cdf7cbef tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:50.145982 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 382/764] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:42:50 2022] GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640 => generated 1280 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:42:50.307537 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-b1d77193-00d2-4e38-bbf4-22d0cdf7cbef tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d12a685d9b419fa3606b5f4d1309fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af209f962144de4ae7e3575a3890096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:42:50.321140 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-b1d77193-00d2-4e38-bbf4-22d0cdf7cbef tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/0b11cb14-b513-4341-a418-ddf26c9e464e" status: 200 len: 1364 microversion: 2.1 time: 0.197093 Jul 15 20:42:50.322518 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 383/765] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:42:50 2022] GET /compute/v2.1/servers/0b11cb14-b513-4341-a418-ddf26c9e464e => generated 1364 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:42:50.473101 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-54b459a1-f06d-4b12-9020-bffdecd53043 req-c9ffde28-8dc4-42ac-b76d-a486003d3b91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b11cb14-b513-4341-a418-ddf26c9e464e", "name": "network-vif-plugged", "status": "completed", "tag": "ee939cda-b869-4fbe-96c0-c0ea588ff114"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:42:50.504919 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-54b459a1-f06d-4b12-9020-bffdecd53043 req-c9ffde28-8dc4-42ac-b76d-a486003d3b91 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:50.506508 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-54b459a1-f06d-4b12-9020-bffdecd53043 req-c9ffde28-8dc4-42ac-b76d-a486003d3b91 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:50.529597 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-54b459a1-f06d-4b12-9020-bffdecd53043 req-c9ffde28-8dc4-42ac-b76d-a486003d3b91 service nova] Creating event network-vif-plugged:ee939cda-b869-4fbe-96c0-c0ea588ff114 for instance 0b11cb14-b513-4341-a418-ddf26c9e464e on hv-cinder-79987 Jul 15 20:42:50.538528 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-54b459a1-f06d-4b12-9020-bffdecd53043 req-c9ffde28-8dc4-42ac-b76d-a486003d3b91 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.177633 Jul 15 20:42:50.567577 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 383/766] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:42:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:42:51.153133 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-3338fa16-fedc-45e7-9658-40cfc956208e tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:51.154646 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-3338fa16-fedc-45e7-9658-40cfc956208e tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 526626a0-8b46-4f4a-9371-4b310ac67640] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:51.161672 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-3338fa16-fedc-45e7-9658-40cfc956208e tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:51.162420 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-3338fa16-fedc-45e7-9658-40cfc956208e tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:51.163425 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-3338fa16-fedc-45e7-9658-40cfc956208e tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:51.163940 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-3338fa16-fedc-45e7-9658-40cfc956208e tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:51.232096 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-3338fa16-fedc-45e7-9658-40cfc956208e tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:42:51.240692 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-3338fa16-fedc-45e7-9658-40cfc956208e tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:42:51.242211 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-3338fa16-fedc-45e7-9658-40cfc956208e tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:42:51.243344 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-3338fa16-fedc-45e7-9658-40cfc956208e tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640" status: 200 len: 1332 microversion: 2.20 time: 0.095359 Jul 15 20:42:51.243897 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 384/767] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:42:51 2022] GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640 => generated 1332 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:42:51.341652 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-da703ae6-fea1-4a5c-b0ac-848a75b6c2f4 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:51.342359 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-da703ae6-fea1-4a5c-b0ac-848a75b6c2f4 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 0b11cb14-b513-4341-a418-ddf26c9e464e] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:51.349037 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-da703ae6-fea1-4a5c-b0ac-848a75b6c2f4 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:51.349490 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-da703ae6-fea1-4a5c-b0ac-848a75b6c2f4 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:51.350265 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-da703ae6-fea1-4a5c-b0ac-848a75b6c2f4 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:51.350750 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-da703ae6-fea1-4a5c-b0ac-848a75b6c2f4 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:51.494818 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-da703ae6-fea1-4a5c-b0ac-848a75b6c2f4 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d12a685d9b419fa3606b5f4d1309fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af209f962144de4ae7e3575a3890096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:42:51.502521 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-da703ae6-fea1-4a5c-b0ac-848a75b6c2f4 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/0b11cb14-b513-4341-a418-ddf26c9e464e" status: 200 len: 1364 microversion: 2.1 time: 0.166260 Jul 15 20:42:51.503093 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 384/768] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:42:51 2022] GET /compute/v2.1/servers/0b11cb14-b513-4341-a418-ddf26c9e464e => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:42:52.263302 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-5d41640a-135b-4d61-a5fc-0804f7e49a74 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:52.263830 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-5d41640a-135b-4d61-a5fc-0804f7e49a74 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 526626a0-8b46-4f4a-9371-4b310ac67640] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:52.270510 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-5d41640a-135b-4d61-a5fc-0804f7e49a74 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:52.270966 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-5d41640a-135b-4d61-a5fc-0804f7e49a74 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:52.271745 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-5d41640a-135b-4d61-a5fc-0804f7e49a74 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:52.272185 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-5d41640a-135b-4d61-a5fc-0804f7e49a74 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:52.342375 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-5d41640a-135b-4d61-a5fc-0804f7e49a74 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:42:52.351298 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-5d41640a-135b-4d61-a5fc-0804f7e49a74 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:42:52.353104 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-5d41640a-135b-4d61-a5fc-0804f7e49a74 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:42:52.354395 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-5d41640a-135b-4d61-a5fc-0804f7e49a74 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640" status: 200 len: 1338 microversion: 2.20 time: 0.095783 Jul 15 20:42:52.355521 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 385/769] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:42:52 2022] GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640 => generated 1338 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:42:52.519307 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-f85d25bb-5262-4e82-96c5-2bae75bd0a6a tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:52.520540 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-f85d25bb-5262-4e82-96c5-2bae75bd0a6a tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 0b11cb14-b513-4341-a418-ddf26c9e464e] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:52.527397 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f85d25bb-5262-4e82-96c5-2bae75bd0a6a tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:52.528187 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f85d25bb-5262-4e82-96c5-2bae75bd0a6a tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:52.529216 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f85d25bb-5262-4e82-96c5-2bae75bd0a6a tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:52.529813 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f85d25bb-5262-4e82-96c5-2bae75bd0a6a tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:52.669370 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-f85d25bb-5262-4e82-96c5-2bae75bd0a6a tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d12a685d9b419fa3606b5f4d1309fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af209f962144de4ae7e3575a3890096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:42:52.682440 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-f85d25bb-5262-4e82-96c5-2bae75bd0a6a tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/0b11cb14-b513-4341-a418-ddf26c9e464e" status: 200 len: 1364 microversion: 2.1 time: 0.166354 Jul 15 20:42:52.683108 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 385/770] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:42:52 2022] GET /compute/v2.1/servers/0b11cb14-b513-4341-a418-ddf26c9e464e => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:42:53.223992 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-1e3c76ad-5f0e-4994-bae8-2867087ff704 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:53.224624 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-1e3c76ad-5f0e-4994-bae8-2867087ff704 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 03bcc792-0b91-4282-a495-d8420a3602fc] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:53.231523 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-1e3c76ad-5f0e-4994-bae8-2867087ff704 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:53.232037 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-1e3c76ad-5f0e-4994-bae8-2867087ff704 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:53.232999 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-1e3c76ad-5f0e-4994-bae8-2867087ff704 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:53.233280 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-1e3c76ad-5f0e-4994-bae8-2867087ff704 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:53.258219 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-1e3c76ad-5f0e-4994-bae8-2867087ff704 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/03bcc792-0b91-4282-a495-d8420a3602fc/ips" status: 200 len: 151 microversion: 2.1 time: 0.038097 Jul 15 20:42:53.259246 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 386/771] 10.222.0.66 () {58 vars in 1247 bytes} [Fri Jul 15 20:42:53 2022] GET /compute/v2.1/servers/03bcc792-0b91-4282-a495-d8420a3602fc/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:42:53.374990 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-792c038a-4959-4b40-b5e6-371505da3f18 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:53.376485 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-792c038a-4959-4b40-b5e6-371505da3f18 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 526626a0-8b46-4f4a-9371-4b310ac67640] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:53.384445 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-792c038a-4959-4b40-b5e6-371505da3f18 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:53.385647 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-792c038a-4959-4b40-b5e6-371505da3f18 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:53.387431 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-792c038a-4959-4b40-b5e6-371505da3f18 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:53.388278 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-792c038a-4959-4b40-b5e6-371505da3f18 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:53.555996 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-792c038a-4959-4b40-b5e6-371505da3f18 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:42:53.565082 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-792c038a-4959-4b40-b5e6-371505da3f18 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:42:53.566597 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-792c038a-4959-4b40-b5e6-371505da3f18 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:42:53.567724 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-792c038a-4959-4b40-b5e6-371505da3f18 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640" status: 200 len: 1406 microversion: 2.20 time: 0.199130 Jul 15 20:42:53.578939 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 386/772] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:42:53 2022] GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640 => generated 1406 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:42:53.582650 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [req-4435d99c-e955-4742-8ecf-1a8931c080d7 req-50ce5b21-cf13-4fda-b690-1e85506f70ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "526626a0-8b46-4f4a-9371-4b310ac67640", "tag": "d578337d-2376-4543-8227-625279e42cf8"}]} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:42:53.598544 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-4435d99c-e955-4742-8ecf-1a8931c080d7 req-50ce5b21-cf13-4fda-b690-1e85506f70ca service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:53.599290 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-4435d99c-e955-4742-8ecf-1a8931c080d7 req-50ce5b21-cf13-4fda-b690-1e85506f70ca service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:53.619143 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.compute.server_external_events [req-4435d99c-e955-4742-8ecf-1a8931c080d7 req-50ce5b21-cf13-4fda-b690-1e85506f70ca service nova] Creating event network-changed:d578337d-2376-4543-8227-625279e42cf8 for instance 526626a0-8b46-4f4a-9371-4b310ac67640 on hv-cinder-79987 Jul 15 20:42:53.625983 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [req-4435d99c-e955-4742-8ecf-1a8931c080d7 req-50ce5b21-cf13-4fda-b690-1e85506f70ca service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055362 Jul 15 20:42:53.627241 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 387/773] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:42:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:42:53.706635 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-6d2908ff-c38e-4142-ba6f-a6a400e0bb28 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:53.707622 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-6d2908ff-c38e-4142-ba6f-a6a400e0bb28 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 0b11cb14-b513-4341-a418-ddf26c9e464e] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:53.717326 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6d2908ff-c38e-4142-ba6f-a6a400e0bb28 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:53.717783 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6d2908ff-c38e-4142-ba6f-a6a400e0bb28 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:53.718881 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6d2908ff-c38e-4142-ba6f-a6a400e0bb28 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:53.719653 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6d2908ff-c38e-4142-ba6f-a6a400e0bb28 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:53.859723 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-6d2908ff-c38e-4142-ba6f-a6a400e0bb28 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d12a685d9b419fa3606b5f4d1309fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af209f962144de4ae7e3575a3890096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:42:53.867324 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-6d2908ff-c38e-4142-ba6f-a6a400e0bb28 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/0b11cb14-b513-4341-a418-ddf26c9e464e" status: 200 len: 1549 microversion: 2.1 time: 0.169676 Jul 15 20:42:53.868150 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 387/774] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:42:53 2022] GET /compute/v2.1/servers/0b11cb14-b513-4341-a418-ddf26c9e464e => generated 1549 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:42:53.884974 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-d733d064-9894-4b69-9d8e-c7463e041beb tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:53.885645 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-d733d064-9894-4b69-9d8e-c7463e041beb tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 0b11cb14-b513-4341-a418-ddf26c9e464e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:53.892753 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d733d064-9894-4b69-9d8e-c7463e041beb tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:53.893278 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d733d064-9894-4b69-9d8e-c7463e041beb tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:53.894108 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d733d064-9894-4b69-9d8e-c7463e041beb tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:53.894608 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d733d064-9894-4b69-9d8e-c7463e041beb tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:53.974112 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-d733d064-9894-4b69-9d8e-c7463e041beb tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/0b11cb14-b513-4341-a418-ddf26c9e464e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093387 Jul 15 20:42:53.974780 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 388/775] 10.222.0.66 () {58 vars in 1274 bytes} [Fri Jul 15 20:42:53 2022] GET /compute/v2.1/servers/0b11cb14-b513-4341-a418-ddf26c9e464e/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:42:54.585909 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-57700684-fdc7-4398-be65-e4f9efd5b7df tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:54.586453 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-57700684-fdc7-4398-be65-e4f9efd5b7df tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 526626a0-8b46-4f4a-9371-4b310ac67640] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:54.593532 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-57700684-fdc7-4398-be65-e4f9efd5b7df tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:54.593983 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-57700684-fdc7-4398-be65-e4f9efd5b7df tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:54.594748 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-57700684-fdc7-4398-be65-e4f9efd5b7df tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:54.595181 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-57700684-fdc7-4398-be65-e4f9efd5b7df tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:54.694855 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-2dcb671d-6e78-4020-9a18-b346f999531e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "116b9955-de6d-46da-97a0-fc40c15b20dd"}} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:42:54.695952 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-2dcb671d-6e78-4020-9a18-b346f999531e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 03bcc792-0b91-4282-a495-d8420a3602fc] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:54.702852 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-2dcb671d-6e78-4020-9a18-b346f999531e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:54.703329 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-2dcb671d-6e78-4020-9a18-b346f999531e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:54.704092 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-2dcb671d-6e78-4020-9a18-b346f999531e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:54.704555 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-2dcb671d-6e78-4020-9a18-b346f999531e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:54.826626 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-57700684-fdc7-4398-be65-e4f9efd5b7df tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:42:54.834564 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-57700684-fdc7-4398-be65-e4f9efd5b7df tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:42:54.836206 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-57700684-fdc7-4398-be65-e4f9efd5b7df tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:42:54.837337 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-57700684-fdc7-4398-be65-e4f9efd5b7df tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640" status: 200 len: 1406 microversion: 2.20 time: 0.255486 Jul 15 20:42:54.837995 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 388/776] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:42:54 2022] GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640 => generated 1406 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:42:55.083431 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-2dcb671d-6e78-4020-9a18-b346f999531e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "POST /compute/v2.1/servers/03bcc792-0b91-4282-a495-d8420a3602fc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.392779 Jul 15 20:42:55.084540 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 389/777] 10.222.0.66 () {60 vars in 1322 bytes} [Fri Jul 15 20:42:54 2022] POST /compute/v2.1/servers/03bcc792-0b91-4282-a495-d8420a3602fc/os-volume_attachments => generated 194 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 20:42:55.274731 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-ea3534db-fe27-4e85-95d7-3296a55e8ebe req-90c31772-022c-44f2-a7df-d37abcdef912 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b11cb14-b513-4341-a418-ddf26c9e464e", "tag": "ee939cda-b869-4fbe-96c0-c0ea588ff114"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:42:55.297061 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-ea3534db-fe27-4e85-95d7-3296a55e8ebe req-90c31772-022c-44f2-a7df-d37abcdef912 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:55.297507 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-ea3534db-fe27-4e85-95d7-3296a55e8ebe req-90c31772-022c-44f2-a7df-d37abcdef912 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:55.311762 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-ea3534db-fe27-4e85-95d7-3296a55e8ebe req-90c31772-022c-44f2-a7df-d37abcdef912 service nova] Creating event network-changed:ee939cda-b869-4fbe-96c0-c0ea588ff114 for instance 0b11cb14-b513-4341-a418-ddf26c9e464e on hv-cinder-79987 Jul 15 20:42:55.317056 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-ea3534db-fe27-4e85-95d7-3296a55e8ebe req-90c31772-022c-44f2-a7df-d37abcdef912 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045906 Jul 15 20:42:55.317740 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 389/778] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:42:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:42:55.856238 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-7ce5b1e6-0ce1-4895-9329-e0d5ab9dca34 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:55.857612 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-7ce5b1e6-0ce1-4895-9329-e0d5ab9dca34 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 526626a0-8b46-4f4a-9371-4b310ac67640] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:55.864304 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-7ce5b1e6-0ce1-4895-9329-e0d5ab9dca34 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:55.864985 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-7ce5b1e6-0ce1-4895-9329-e0d5ab9dca34 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:55.866052 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-7ce5b1e6-0ce1-4895-9329-e0d5ab9dca34 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:55.866494 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-7ce5b1e6-0ce1-4895-9329-e0d5ab9dca34 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:56.017697 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-7ce5b1e6-0ce1-4895-9329-e0d5ab9dca34 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:42:56.030650 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-7ce5b1e6-0ce1-4895-9329-e0d5ab9dca34 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:42:56.033270 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-7ce5b1e6-0ce1-4895-9329-e0d5ab9dca34 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:42:56.035138 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-7ce5b1e6-0ce1-4895-9329-e0d5ab9dca34 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640" status: 200 len: 1406 microversion: 2.20 time: 0.183645 Jul 15 20:42:56.035828 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 390/779] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:42:55 2022] GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640 => generated 1406 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:42:57.055259 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-43cc9cb9-6a86-4d6a-8afe-bacb9e1f9d63 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:57.055890 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-43cc9cb9-6a86-4d6a-8afe-bacb9e1f9d63 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 526626a0-8b46-4f4a-9371-4b310ac67640] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:57.062461 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-43cc9cb9-6a86-4d6a-8afe-bacb9e1f9d63 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:57.062900 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-43cc9cb9-6a86-4d6a-8afe-bacb9e1f9d63 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:57.063651 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-43cc9cb9-6a86-4d6a-8afe-bacb9e1f9d63 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:57.064075 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-43cc9cb9-6a86-4d6a-8afe-bacb9e1f9d63 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:57.197858 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-43cc9cb9-6a86-4d6a-8afe-bacb9e1f9d63 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:42:57.205641 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-43cc9cb9-6a86-4d6a-8afe-bacb9e1f9d63 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:42:57.207120 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-43cc9cb9-6a86-4d6a-8afe-bacb9e1f9d63 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:42:57.208195 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-43cc9cb9-6a86-4d6a-8afe-bacb9e1f9d63 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640" status: 200 len: 1406 microversion: 2.20 time: 0.157693 Jul 15 20:42:57.208775 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 390/780] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:42:57 2022] GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:42:58.226828 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-9c37b49e-3334-43cb-80c4-b1b5fbb32782 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:58.227613 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-9c37b49e-3334-43cb-80c4-b1b5fbb32782 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 526626a0-8b46-4f4a-9371-4b310ac67640] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:58.235822 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-9c37b49e-3334-43cb-80c4-b1b5fbb32782 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:58.236265 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-9c37b49e-3334-43cb-80c4-b1b5fbb32782 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:58.237053 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-9c37b49e-3334-43cb-80c4-b1b5fbb32782 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:58.237511 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-9c37b49e-3334-43cb-80c4-b1b5fbb32782 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:58.347733 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-143d339c-15f6-438a-aa1a-bd37c91ae9af req-b26fe47d-216e-4ed4-9dae-356ec84fd957 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "526626a0-8b46-4f4a-9371-4b310ac67640", "name": "network-vif-plugged", "status": "completed", "tag": "d578337d-2376-4543-8227-625279e42cf8"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:42:58.357645 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-143d339c-15f6-438a-aa1a-bd37c91ae9af req-b26fe47d-216e-4ed4-9dae-356ec84fd957 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:58.357918 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-143d339c-15f6-438a-aa1a-bd37c91ae9af req-b26fe47d-216e-4ed4-9dae-356ec84fd957 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:58.371055 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-143d339c-15f6-438a-aa1a-bd37c91ae9af req-b26fe47d-216e-4ed4-9dae-356ec84fd957 service nova] Creating event network-vif-plugged:d578337d-2376-4543-8227-625279e42cf8 for instance 526626a0-8b46-4f4a-9371-4b310ac67640 on hv-cinder-79987 Jul 15 20:42:58.376819 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-143d339c-15f6-438a-aa1a-bd37c91ae9af req-b26fe47d-216e-4ed4-9dae-356ec84fd957 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032388 Jul 15 20:42:58.377945 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 391/781] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:42:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 20:42:58.378988 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-9c37b49e-3334-43cb-80c4-b1b5fbb32782 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:42:58.387153 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-9c37b49e-3334-43cb-80c4-b1b5fbb32782 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:42:58.388687 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-9c37b49e-3334-43cb-80c4-b1b5fbb32782 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:42:58.389946 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-9c37b49e-3334-43cb-80c4-b1b5fbb32782 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640" status: 200 len: 1406 microversion: 2.20 time: 0.167123 Jul 15 20:42:58.390488 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 391/782] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:42:58 2022] GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640 => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:42:59.408778 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-1a6a80e7-6d40-44d4-b80f-2136b6a7fff3 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:42:59.409466 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-1a6a80e7-6d40-44d4-b80f-2136b6a7fff3 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 526626a0-8b46-4f4a-9371-4b310ac67640] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:42:59.415819 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1a6a80e7-6d40-44d4-b80f-2136b6a7fff3 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:59.416253 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1a6a80e7-6d40-44d4-b80f-2136b6a7fff3 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:59.417054 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1a6a80e7-6d40-44d4-b80f-2136b6a7fff3 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:42:59.417479 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1a6a80e7-6d40-44d4-b80f-2136b6a7fff3 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:42:59.554676 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-1a6a80e7-6d40-44d4-b80f-2136b6a7fff3 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:42:59.562770 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-1a6a80e7-6d40-44d4-b80f-2136b6a7fff3 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:42:59.564286 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-1a6a80e7-6d40-44d4-b80f-2136b6a7fff3 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:42:59.565397 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-1a6a80e7-6d40-44d4-b80f-2136b6a7fff3 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640" status: 200 len: 1406 microversion: 2.20 time: 0.161350 Jul 15 20:42:59.565961 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 392/783] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:42:59 2022] GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:43:00.585774 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-4a472913-d2b9-447b-9374-38eb15e02b04 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:00.586384 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-4a472913-d2b9-447b-9374-38eb15e02b04 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 526626a0-8b46-4f4a-9371-4b310ac67640] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:00.588848 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_cell0:SELECT=4 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:43:00.590177 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_cell0:SELECT=16 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:43:00.597158 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-4a472913-d2b9-447b-9374-38eb15e02b04 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:00.597948 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-4a472913-d2b9-447b-9374-38eb15e02b04 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:00.599089 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-4a472913-d2b9-447b-9374-38eb15e02b04 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:00.599537 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-4a472913-d2b9-447b-9374-38eb15e02b04 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:00.605903 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:43:00.772688 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-4a472913-d2b9-447b-9374-38eb15e02b04 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:00.781875 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-4a472913-d2b9-447b-9374-38eb15e02b04 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:00.783381 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-4a472913-d2b9-447b-9374-38eb15e02b04 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:00.784574 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-4a472913-d2b9-447b-9374-38eb15e02b04 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640" status: 200 len: 1598 microversion: 2.20 time: 0.202873 Jul 15 20:43:00.785367 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 392/784] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:43:00 2022] GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640 => generated 1598 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:43:00.803858 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-0d4faa2b-0527-4808-b759-a12a81563f44 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:00.805101 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-0d4faa2b-0527-4808-b759-a12a81563f44 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 526626a0-8b46-4f4a-9371-4b310ac67640] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:00.807146 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell0:SELECT=8 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:43:00.813935 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0d4faa2b-0527-4808-b759-a12a81563f44 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:00.814302 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0d4faa2b-0527-4808-b759-a12a81563f44 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:00.815063 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0d4faa2b-0527-4808-b759-a12a81563f44 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:00.815487 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0d4faa2b-0527-4808-b759-a12a81563f44 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:00.896235 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-0d4faa2b-0527-4808-b759-a12a81563f44 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.096850 Jul 15 20:43:00.896888 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 393/785] 10.222.0.66 () {60 vars in 1315 bytes} [Fri Jul 15 20:43:00 2022] GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 20:43:01.801851 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-442b277d-d507-4ce1-90b7-5c55df59703a tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:01.802384 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-442b277d-d507-4ce1-90b7-5c55df59703a tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 03bcc792-0b91-4282-a495-d8420a3602fc] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:01.809557 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-442b277d-d507-4ce1-90b7-5c55df59703a tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:01.810011 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-442b277d-d507-4ce1-90b7-5c55df59703a tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:01.810789 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-442b277d-d507-4ce1-90b7-5c55df59703a tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:01.811230 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-442b277d-d507-4ce1-90b7-5c55df59703a tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:01.863219 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-4ce82d62-0863-4481-b582-a87e81e12345 req-30099216-7798-4d49-8c42-355186d7173d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "526626a0-8b46-4f4a-9371-4b310ac67640", "tag": "d578337d-2376-4543-8227-625279e42cf8"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:43:01.873664 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-4ce82d62-0863-4481-b582-a87e81e12345 req-30099216-7798-4d49-8c42-355186d7173d service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:01.873664 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-4ce82d62-0863-4481-b582-a87e81e12345 req-30099216-7798-4d49-8c42-355186d7173d service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:01.884883 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-4ce82d62-0863-4481-b582-a87e81e12345 req-30099216-7798-4d49-8c42-355186d7173d service nova] Creating event network-changed:d578337d-2376-4543-8227-625279e42cf8 for instance 526626a0-8b46-4f4a-9371-4b310ac67640 on hv-cinder-79987 Jul 15 20:43:01.889963 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-4ce82d62-0863-4481-b582-a87e81e12345 req-30099216-7798-4d49-8c42-355186d7173d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031123 Jul 15 20:43:01.890861 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 394/786] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:43:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 20:43:01.904151 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.objects.instance [None req-442b277d-d507-4ce1-90b7-5c55df59703a tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lazy-loading 'services' on Instance uuid 03bcc792-0b91-4282-a495-d8420a3602fc {{(pid=124430) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 20:43:01.980824 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-442b277d-d507-4ce1-90b7-5c55df59703a tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "DELETE /compute/v2.1/servers/03bcc792-0b91-4282-a495-d8420a3602fc/os-volume_attachments/116b9955-de6d-46da-97a0-fc40c15b20dd" status: 202 len: 0 microversion: 2.1 time: 0.182248 Jul 15 20:43:01.981670 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 393/787] 10.222.0.66 () {58 vars in 1415 bytes} [Fri Jul 15 20:43:01 2022] DELETE /compute/v2.1/servers/03bcc792-0b91-4282-a495-d8420a3602fc/os-volume_attachments/116b9955-de6d-46da-97a0-fc40c15b20dd => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 20:43:01.992322 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-9e966ea1-237c-4ed3-98ee-e85fa2503b3e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:01.994180 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-9e966ea1-237c-4ed3-98ee-e85fa2503b3e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 03bcc792-0b91-4282-a495-d8420a3602fc] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:02.004233 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9e966ea1-237c-4ed3-98ee-e85fa2503b3e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:02.004721 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9e966ea1-237c-4ed3-98ee-e85fa2503b3e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:02.005509 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9e966ea1-237c-4ed3-98ee-e85fa2503b3e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:02.006070 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9e966ea1-237c-4ed3-98ee-e85fa2503b3e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:02.039732 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-9e966ea1-237c-4ed3-98ee-e85fa2503b3e tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/03bcc792-0b91-4282-a495-d8420a3602fc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053099 Jul 15 20:43:02.040625 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 395/788] 10.222.0.66 () {58 vars in 1301 bytes} [Fri Jul 15 20:43:01 2022] GET /compute/v2.1/servers/03bcc792-0b91-4282-a495-d8420a3602fc/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:43:03.052298 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-89eb2de4-e7d5-4546-8ebe-33efe6d2f4ea tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:03.053506 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-89eb2de4-e7d5-4546-8ebe-33efe6d2f4ea tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 03bcc792-0b91-4282-a495-d8420a3602fc] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:03.060574 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-89eb2de4-e7d5-4546-8ebe-33efe6d2f4ea tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:03.061032 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-89eb2de4-e7d5-4546-8ebe-33efe6d2f4ea tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:03.061809 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-89eb2de4-e7d5-4546-8ebe-33efe6d2f4ea tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:03.062248 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-89eb2de4-e7d5-4546-8ebe-33efe6d2f4ea tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:03.092008 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-89eb2de4-e7d5-4546-8ebe-33efe6d2f4ea tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/03bcc792-0b91-4282-a495-d8420a3602fc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044500 Jul 15 20:43:03.092587 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 394/789] 10.222.0.66 () {58 vars in 1301 bytes} [Fri Jul 15 20:43:03 2022] GET /compute/v2.1/servers/03bcc792-0b91-4282-a495-d8420a3602fc/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 15 20:43:03.149198 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-9958b3fb-970b-4f75-a2d9-d54085d7d17c tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:03.149708 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-9958b3fb-970b-4f75-a2d9-d54085d7d17c tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 03bcc792-0b91-4282-a495-d8420a3602fc] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:03.156792 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9958b3fb-970b-4f75-a2d9-d54085d7d17c tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:03.157239 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9958b3fb-970b-4f75-a2d9-d54085d7d17c tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:03.157981 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9958b3fb-970b-4f75-a2d9-d54085d7d17c tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:03.158408 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9958b3fb-970b-4f75-a2d9-d54085d7d17c tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:03.183188 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-9958b3fb-970b-4f75-a2d9-d54085d7d17c tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 03bcc792-0b91-4282-a495-d8420a3602fc] Going to try to terminate instance {{(pid=124432) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 20:43:03.206605 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell1:SELECT=100 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:43:03.257414 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-9958b3fb-970b-4f75-a2d9-d54085d7d17c tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "DELETE /compute/v2.1/servers/03bcc792-0b91-4282-a495-d8420a3602fc" status: 204 len: 0 microversion: 2.1 time: 0.111877 Jul 15 20:43:03.257995 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 396/790] 10.222.0.66 () {58 vars in 1238 bytes} [Fri Jul 15 20:43:03 2022] DELETE /compute/v2.1/servers/03bcc792-0b91-4282-a495-d8420a3602fc => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 20:43:03.266876 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-d9a4fda6-64b7-48a8-b603-839c794cda45 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:03.267488 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-d9a4fda6-64b7-48a8-b603-839c794cda45 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 03bcc792-0b91-4282-a495-d8420a3602fc] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:03.273880 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d9a4fda6-64b7-48a8-b603-839c794cda45 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:03.274328 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d9a4fda6-64b7-48a8-b603-839c794cda45 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:03.275082 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d9a4fda6-64b7-48a8-b603-839c794cda45 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:03.275719 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d9a4fda6-64b7-48a8-b603-839c794cda45 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:03.405737 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-d9a4fda6-64b7-48a8-b603-839c794cda45 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:03.413154 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-d9a4fda6-64b7-48a8-b603-839c794cda45 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/03bcc792-0b91-4282-a495-d8420a3602fc" status: 200 len: 1682 microversion: 2.1 time: 0.150104 Jul 15 20:43:03.413716 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 395/791] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:43:03 2022] GET /compute/v2.1/servers/03bcc792-0b91-4282-a495-d8420a3602fc => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:43:04.431332 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-e00caa48-b1cc-4db2-9ec7-a23caa84d138 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:04.432020 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-e00caa48-b1cc-4db2-9ec7-a23caa84d138 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 03bcc792-0b91-4282-a495-d8420a3602fc] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:04.439227 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e00caa48-b1cc-4db2-9ec7-a23caa84d138 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:04.439664 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e00caa48-b1cc-4db2-9ec7-a23caa84d138 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:04.440432 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e00caa48-b1cc-4db2-9ec7-a23caa84d138 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:04.440860 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e00caa48-b1cc-4db2-9ec7-a23caa84d138 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:04.573245 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-e00caa48-b1cc-4db2-9ec7-a23caa84d138 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:04.581516 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-e00caa48-b1cc-4db2-9ec7-a23caa84d138 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/03bcc792-0b91-4282-a495-d8420a3602fc" status: 200 len: 1682 microversion: 2.1 time: 0.154396 Jul 15 20:43:04.582070 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 397/792] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:43:04 2022] GET /compute/v2.1/servers/03bcc792-0b91-4282-a495-d8420a3602fc => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:43:05.598679 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-3d3bc6fd-ea18-4e76-a622-d880e4db26fb tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:05.599289 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-3d3bc6fd-ea18-4e76-a622-d880e4db26fb tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 03bcc792-0b91-4282-a495-d8420a3602fc] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:05.606590 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-3d3bc6fd-ea18-4e76-a622-d880e4db26fb tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:05.606894 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-3d3bc6fd-ea18-4e76-a622-d880e4db26fb tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:05.607673 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-3d3bc6fd-ea18-4e76-a622-d880e4db26fb tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:05.608198 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-3d3bc6fd-ea18-4e76-a622-d880e4db26fb tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:05.670396 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-3d3bc6fd-ea18-4e76-a622-d880e4db26fb tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b5962b37b2470099436609425f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a593e163e74a7b9db61133e5c22035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:05.678098 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-3d3bc6fd-ea18-4e76-a622-d880e4db26fb tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/03bcc792-0b91-4282-a495-d8420a3602fc" status: 200 len: 1615 microversion: 2.1 time: 0.083194 Jul 15 20:43:05.682037 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 396/793] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:43:05 2022] GET /compute/v2.1/servers/03bcc792-0b91-4282-a495-d8420a3602fc => generated 1615 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:43:05.740264 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-610b85ca-1bae-41bf-a213-5e7af57a7f4b req-9f9d8c87-2f83-4453-8e7f-bbf735e4cc91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03bcc792-0b91-4282-a495-d8420a3602fc", "name": "network-vif-deleted", "tag": "997ebb45-8116-4a67-8134-9843c9d6226d"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:43:05.751603 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-610b85ca-1bae-41bf-a213-5e7af57a7f4b req-9f9d8c87-2f83-4453-8e7f-bbf735e4cc91 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:05.752762 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-610b85ca-1bae-41bf-a213-5e7af57a7f4b req-9f9d8c87-2f83-4453-8e7f-bbf735e4cc91 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:05.765578 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-610b85ca-1bae-41bf-a213-5e7af57a7f4b req-9f9d8c87-2f83-4453-8e7f-bbf735e4cc91 service nova] Creating event network-vif-deleted:997ebb45-8116-4a67-8134-9843c9d6226d for instance 03bcc792-0b91-4282-a495-d8420a3602fc on hv-cinder-79987 Jul 15 20:43:05.771145 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-610b85ca-1bae-41bf-a213-5e7af57a7f4b req-9f9d8c87-2f83-4453-8e7f-bbf735e4cc91 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035239 Jul 15 20:43:05.772446 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 398/794] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:43:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:43:06.695089 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-a11a9f4b-0545-4686-a387-99d58397cd64 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:06.695702 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-a11a9f4b-0545-4686-a387-99d58397cd64 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 03bcc792-0b91-4282-a495-d8420a3602fc] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:06.703014 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-a11a9f4b-0545-4686-a387-99d58397cd64 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:06.703466 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-a11a9f4b-0545-4686-a387-99d58397cd64 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:06.704234 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-a11a9f4b-0545-4686-a387-99d58397cd64 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:06.704705 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-a11a9f4b-0545-4686-a387-99d58397cd64 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:06.718596 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.wsgi [None req-a11a9f4b-0545-4686-a387-99d58397cd64 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] HTTP exception thrown: Instance 03bcc792-0b91-4282-a495-d8420a3602fc could not be found. Jul 15 20:43:06.720338 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-a11a9f4b-0545-4686-a387-99d58397cd64 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Request method failure captured: Jul 15 20:43:06.720338 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: request: GET /compute/v2.1/servers/03bcc792-0b91-4282-a495-d8420a3602fc HTTP/1.1 Jul 15 20:43:06.720338 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Accept: application/json Jul 15 20:43:06.720338 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Accept-Encoding: identity Jul 15 20:43:06.720338 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Connection: close Jul 15 20:43:06.720338 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Content-Length: 0 Jul 15 20:43:06.720338 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Content-Type: application/json Jul 15 20:43:06.720338 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Host: 10.222.0.66 Jul 15 20:43:06.720338 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Openstack-System-Scope: None Jul 15 20:43:06.720338 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: User-Agent: python-urllib3/1.26.9 Jul 15 20:43:06.720338 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Auth-Token: gAAAAABi0c_kH9ys3aP35h1LWWw3r1ieyA8CI0v0WIPPxjHmBB6aGubC4LmfLrm23mJ8HvmdkzR7wDAmSNK2w9OIr-gnn6Blv4WbaRzcu_QA8HGYGiqbz987b1vb5xUWoBYf2fTfD1m5oPgbP0g7S9YRfksUIFxkz4MW4lkoTMD9FFmUr-jPyfM Jul 15 20:43:06.720338 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Domain-Id: None Jul 15 20:43:06.720338 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Domain-Name: None Jul 15 20:43:06.720338 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Identity-Status: Confirmed Jul 15 20:43:06.720338 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Is-Admin-Project: True Jul 15 20:43:06.720338 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Domain-Id: default Jul 15 20:43:06.720338 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Domain-Name: Default Jul 15 20:43:06.720338 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Id: 78a593e163e74a7b9db61133e5c22035 Jul 15 20:43:06.720338 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Name: tempest-AttachVolumeNegativeTest-846080947 Jul 15 20:43:06.720338 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Role: member,reader Jul 15 20:43:06.720338 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Roles: member,reader Jul 15 20:43:06.721876 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/78a593e163e74a7b9db61133e5c22035"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_78a593e163e74a7b9db61133e5c22035"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/78a593e163e74a7b9db61133e5c22035"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/78a593e163e74a7b9db61133e5c22035"}]}] Jul 15 20:43:06.721876 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant: tempest-AttachVolumeNegativeTest-846080947 Jul 15 20:43:06.721876 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant-Id: 78a593e163e74a7b9db61133e5c22035 Jul 15 20:43:06.721876 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-846080947 Jul 15 20:43:06.721876 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User: tempest-AttachVolumeNegativeTest-846080947-project Jul 15 20:43:06.721876 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Domain-Id: default Jul 15 20:43:06.721876 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Domain-Name: Default Jul 15 20:43:06.721876 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Id: c0b5962b37b2470099436609425f7423 Jul 15 20:43:06.721876 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Name: tempest-AttachVolumeNegativeTest-846080947-project Jul 15 20:43:06.721876 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: method: > Jul 15 20:43:06.721876 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: exception: Instance 03bcc792-0b91-4282-a495-d8420a3602fc could not be found. Jul 15 20:43:06.721876 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: action_args: {'id': '03bcc792-0b91-4282-a495-d8420a3602fc'} Jul 15 20:43:06.722631 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 20:43:06.722631 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:43:06.722631 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 20:43:06.722631 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 20:43:06.722631 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 20:43:06.722631 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 20:43:06.722631 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 20:43:06.722631 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 20:43:06.722631 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 20:43:06.722631 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 20:43:06.722631 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03bcc792-0b91-4282-a495-d8420a3602fc could not be found. Jul 15 20:43:06.722631 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:43:06.722631 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:43:06.722631 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:43:06.722631 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:43:06.722631 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:43:06.722631 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:43:06.722631 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 20:43:06.722631 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 20:43:06.722631 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 20:43:06.723860 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 20:43:06.723860 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 20:43:06.723860 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 20:43:06.723860 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 20:43:06.723860 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 20:43:06.723860 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 20:43:06.723860 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 20:43:06.723860 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03bcc792-0b91-4282-a495-d8420a3602fc could not be found. Jul 15 20:43:06.723860 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:43:06.723860 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:43:06.723860 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:43:06.723860 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:43:06.723860 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:43:06.723860 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:43:06.723860 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 20:43:06.723860 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 20:43:06.723860 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03bcc792-0b91-4282-a495-d8420a3602fc could not be found. Jul 15 20:43:06.723860 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:43:06.725023 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-a11a9f4b-0545-4686-a387-99d58397cd64 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Returning 404 to user: Instance 03bcc792-0b91-4282-a495-d8420a3602fc could not be found. {{(pid=124430) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 20:43:06.725023 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-a11a9f4b-0545-4686-a387-99d58397cd64 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/03bcc792-0b91-4282-a495-d8420a3602fc" status: 404 len: 111 microversion: 2.1 time: 0.030713 Jul 15 20:43:06.725023 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 397/795] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:43:06 2022] GET /compute/v2.1/servers/03bcc792-0b91-4282-a495-d8420a3602fc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 20:43:06.731479 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-e8f7f9ed-d6fd-4f28-91be-85bb261ea4f1 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '.version_select at 0x7ff518041af0>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:06.751846 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-e8f7f9ed-d6fd-4f28-91be-85bb261ea4f1 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-503783592" status: 202 len: 0 microversion: 2.1 time: 0.024460 Jul 15 20:43:06.752589 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 399/796] 10.222.0.66 () {58 vars in 1217 bytes} [Fri Jul 15 20:43:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-503783592 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 20:43:07.291087 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-e399d739-4f9b-42c2-b182-a3e4ed98fe24 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:43:07.291599 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-e399d739-4f9b-42c2-b182-a3e4ed98fe24 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] [instance: b02f18ea-fd0b-4edd-97a7-17621ab67c8f] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:07.298892 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e399d739-4f9b-42c2-b182-a3e4ed98fe24 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:07.299344 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e399d739-4f9b-42c2-b182-a3e4ed98fe24 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:07.300239 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e399d739-4f9b-42c2-b182-a3e4ed98fe24 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:07.300805 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e399d739-4f9b-42c2-b182-a3e4ed98fe24 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:07.324684 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.objects.instance [None req-e399d739-4f9b-42c2-b182-a3e4ed98fe24 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lazy-loading 'flavor' on Instance uuid b02f18ea-fd0b-4edd-97a7-17621ab67c8f {{(pid=124430) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 20:43:07.400088 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-e399d739-4f9b-42c2-b182-a3e4ed98fe24 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] 10.222.0.66 "POST /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f/action" status: 202 len: 0 microversion: 2.1 time: 0.113006 Jul 15 20:43:07.400719 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 398/797] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 15 20:43:07 2022] POST /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 20:43:07.409576 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-f3e45c09-7e6a-4e61-9e7c-f1e7692d6975 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:07.410324 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-f3e45c09-7e6a-4e61-9e7c-f1e7692d6975 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] [instance: b02f18ea-fd0b-4edd-97a7-17621ab67c8f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:07.417279 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f3e45c09-7e6a-4e61-9e7c-f1e7692d6975 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:07.418656 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f3e45c09-7e6a-4e61-9e7c-f1e7692d6975 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:07.419461 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f3e45c09-7e6a-4e61-9e7c-f1e7692d6975 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:07.419904 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f3e45c09-7e6a-4e61-9e7c-f1e7692d6975 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:07.565818 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-f3e45c09-7e6a-4e61-9e7c-f1e7692d6975 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e27fccbf854a8b8c9d6d099893f783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e1593c67704dbbafad13310ca35448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:07.574769 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-f3e45c09-7e6a-4e61-9e7c-f1e7692d6975 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] 10.222.0.66 "GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f" status: 200 len: 1567 microversion: 2.1 time: 0.168490 Jul 15 20:43:07.575351 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 400/798] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:43:07 2022] GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:43:08.593274 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-5ffc7a8a-5922-48a5-9b7c-3f8620b1470b tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:08.593891 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-5ffc7a8a-5922-48a5-9b7c-3f8620b1470b tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] [instance: b02f18ea-fd0b-4edd-97a7-17621ab67c8f] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:08.600131 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-5ffc7a8a-5922-48a5-9b7c-3f8620b1470b tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:08.600613 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-5ffc7a8a-5922-48a5-9b7c-3f8620b1470b tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:08.601374 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-5ffc7a8a-5922-48a5-9b7c-3f8620b1470b tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:08.601808 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-5ffc7a8a-5922-48a5-9b7c-3f8620b1470b tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:08.734847 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-5ffc7a8a-5922-48a5-9b7c-3f8620b1470b tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e27fccbf854a8b8c9d6d099893f783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e1593c67704dbbafad13310ca35448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:08.738853 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-0eabedcd-7cdd-49b7-a786-f7ff01e1579c tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:08.739371 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-0eabedcd-7cdd-49b7-a786-f7ff01e1579c tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 03bcc792-0b91-4282-a495-d8420a3602fc] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:08.741890 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_api:DELETE=2,nova_api:SELECT=70,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:43:08.742919 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-5ffc7a8a-5922-48a5-9b7c-3f8620b1470b tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] 10.222.0.66 "GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f" status: 200 len: 1567 microversion: 2.1 time: 0.155021 Jul 15 20:43:08.743644 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 399/799] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:43:08 2022] GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:43:08.747227 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0eabedcd-7cdd-49b7-a786-f7ff01e1579c tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:08.747673 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0eabedcd-7cdd-49b7-a786-f7ff01e1579c tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:08.748471 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0eabedcd-7cdd-49b7-a786-f7ff01e1579c tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:08.748908 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0eabedcd-7cdd-49b7-a786-f7ff01e1579c tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:08.764801 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.wsgi [None req-0eabedcd-7cdd-49b7-a786-f7ff01e1579c tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] HTTP exception thrown: Instance 03bcc792-0b91-4282-a495-d8420a3602fc could not be found. Jul 15 20:43:08.766618 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-0eabedcd-7cdd-49b7-a786-f7ff01e1579c tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Request method failure captured: Jul 15 20:43:08.766618 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: request: DELETE /compute/v2.1/servers/03bcc792-0b91-4282-a495-d8420a3602fc HTTP/1.1 Jul 15 20:43:08.766618 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Accept: application/json Jul 15 20:43:08.766618 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Accept-Encoding: identity Jul 15 20:43:08.766618 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Connection: close Jul 15 20:43:08.766618 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Content-Length: 0 Jul 15 20:43:08.766618 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Content-Type: application/json Jul 15 20:43:08.766618 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Host: 10.222.0.66 Jul 15 20:43:08.766618 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Openstack-System-Scope: None Jul 15 20:43:08.766618 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: User-Agent: python-urllib3/1.26.9 Jul 15 20:43:08.766618 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Auth-Token: gAAAAABi0c_kH9ys3aP35h1LWWw3r1ieyA8CI0v0WIPPxjHmBB6aGubC4LmfLrm23mJ8HvmdkzR7wDAmSNK2w9OIr-gnn6Blv4WbaRzcu_QA8HGYGiqbz987b1vb5xUWoBYf2fTfD1m5oPgbP0g7S9YRfksUIFxkz4MW4lkoTMD9FFmUr-jPyfM Jul 15 20:43:08.766618 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Domain-Id: None Jul 15 20:43:08.766618 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Domain-Name: None Jul 15 20:43:08.766618 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Identity-Status: Confirmed Jul 15 20:43:08.766618 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Is-Admin-Project: True Jul 15 20:43:08.766618 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Domain-Id: default Jul 15 20:43:08.766618 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Domain-Name: Default Jul 15 20:43:08.766618 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Id: 78a593e163e74a7b9db61133e5c22035 Jul 15 20:43:08.766618 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Name: tempest-AttachVolumeNegativeTest-846080947 Jul 15 20:43:08.766618 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Role: member,reader Jul 15 20:43:08.766618 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Roles: member,reader Jul 15 20:43:08.768242 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/78a593e163e74a7b9db61133e5c22035"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_78a593e163e74a7b9db61133e5c22035"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/78a593e163e74a7b9db61133e5c22035"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/78a593e163e74a7b9db61133e5c22035"}]}] Jul 15 20:43:08.768242 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Tenant: tempest-AttachVolumeNegativeTest-846080947 Jul 15 20:43:08.768242 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Tenant-Id: 78a593e163e74a7b9db61133e5c22035 Jul 15 20:43:08.768242 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-846080947 Jul 15 20:43:08.768242 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User: tempest-AttachVolumeNegativeTest-846080947-project Jul 15 20:43:08.768242 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Domain-Id: default Jul 15 20:43:08.768242 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Domain-Name: Default Jul 15 20:43:08.768242 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Id: c0b5962b37b2470099436609425f7423 Jul 15 20:43:08.768242 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Name: tempest-AttachVolumeNegativeTest-846080947-project Jul 15 20:43:08.768242 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: method: > Jul 15 20:43:08.768242 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: exception: Instance 03bcc792-0b91-4282-a495-d8420a3602fc could not be found. Jul 15 20:43:08.768242 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: action_args: {'id': '03bcc792-0b91-4282-a495-d8420a3602fc'} Jul 15 20:43:08.769096 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 20:43:08.769096 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:43:08.769096 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 20:43:08.769096 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 20:43:08.769096 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 20:43:08.769096 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 20:43:08.769096 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 20:43:08.769096 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 20:43:08.769096 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 20:43:08.769096 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 20:43:08.769096 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03bcc792-0b91-4282-a495-d8420a3602fc could not be found. Jul 15 20:43:08.769096 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:43:08.769096 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:43:08.769096 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:43:08.769096 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:43:08.769096 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:43:08.769096 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:43:08.769096 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 20:43:08.769096 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 20:43:08.769096 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 20:43:08.770300 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 20:43:08.770300 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 15 20:43:08.770300 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 15 20:43:08.770300 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 15 20:43:08.770300 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 15 20:43:08.770300 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 20:43:08.770300 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 20:43:08.770300 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 20:43:08.770300 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 20:43:08.770300 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03bcc792-0b91-4282-a495-d8420a3602fc could not be found. Jul 15 20:43:08.770300 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:43:08.770300 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:43:08.770300 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:43:08.770300 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:43:08.770300 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:43:08.770300 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:43:08.770300 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 20:43:08.770300 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 20:43:08.770300 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03bcc792-0b91-4282-a495-d8420a3602fc could not be found. Jul 15 20:43:08.770300 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:43:08.771499 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-0eabedcd-7cdd-49b7-a786-f7ff01e1579c tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Returning 404 to user: Instance 03bcc792-0b91-4282-a495-d8420a3602fc could not be found. {{(pid=124432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 20:43:08.771499 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-0eabedcd-7cdd-49b7-a786-f7ff01e1579c tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "DELETE /compute/v2.1/servers/03bcc792-0b91-4282-a495-d8420a3602fc" status: 404 len: 111 microversion: 2.1 time: 0.032944 Jul 15 20:43:08.771499 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 401/800] 10.222.0.66 () {58 vars in 1238 bytes} [Fri Jul 15 20:43:08 2022] DELETE /compute/v2.1/servers/03bcc792-0b91-4282-a495-d8420a3602fc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 15 20:43:08.776552 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-f7234b56-caeb-459c-89e5-10c14afa92ab tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:08.777861 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-f7234b56-caeb-459c-89e5-10c14afa92ab tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 03bcc792-0b91-4282-a495-d8420a3602fc] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:08.783905 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-f7234b56-caeb-459c-89e5-10c14afa92ab tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:08.784350 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-f7234b56-caeb-459c-89e5-10c14afa92ab tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:08.785443 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-f7234b56-caeb-459c-89e5-10c14afa92ab tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:08.786209 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-f7234b56-caeb-459c-89e5-10c14afa92ab tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:08.801876 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.wsgi [None req-f7234b56-caeb-459c-89e5-10c14afa92ab tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] HTTP exception thrown: Instance 03bcc792-0b91-4282-a495-d8420a3602fc could not be found. Jul 15 20:43:08.803519 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-f7234b56-caeb-459c-89e5-10c14afa92ab tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Request method failure captured: Jul 15 20:43:08.803519 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: request: GET /compute/v2.1/servers/03bcc792-0b91-4282-a495-d8420a3602fc HTTP/1.1 Jul 15 20:43:08.803519 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Accept: application/json Jul 15 20:43:08.803519 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Accept-Encoding: identity Jul 15 20:43:08.803519 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Connection: close Jul 15 20:43:08.803519 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Content-Length: 0 Jul 15 20:43:08.803519 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Content-Type: application/json Jul 15 20:43:08.803519 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Host: 10.222.0.66 Jul 15 20:43:08.803519 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Openstack-System-Scope: None Jul 15 20:43:08.803519 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: User-Agent: python-urllib3/1.26.9 Jul 15 20:43:08.803519 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Auth-Token: gAAAAABi0c_kH9ys3aP35h1LWWw3r1ieyA8CI0v0WIPPxjHmBB6aGubC4LmfLrm23mJ8HvmdkzR7wDAmSNK2w9OIr-gnn6Blv4WbaRzcu_QA8HGYGiqbz987b1vb5xUWoBYf2fTfD1m5oPgbP0g7S9YRfksUIFxkz4MW4lkoTMD9FFmUr-jPyfM Jul 15 20:43:08.803519 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Domain-Id: None Jul 15 20:43:08.803519 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Domain-Name: None Jul 15 20:43:08.803519 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Identity-Status: Confirmed Jul 15 20:43:08.803519 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Is-Admin-Project: True Jul 15 20:43:08.803519 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Domain-Id: default Jul 15 20:43:08.803519 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Domain-Name: Default Jul 15 20:43:08.803519 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Id: 78a593e163e74a7b9db61133e5c22035 Jul 15 20:43:08.803519 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Name: tempest-AttachVolumeNegativeTest-846080947 Jul 15 20:43:08.803519 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Role: member,reader Jul 15 20:43:08.803519 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Roles: member,reader Jul 15 20:43:08.805647 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/78a593e163e74a7b9db61133e5c22035"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_78a593e163e74a7b9db61133e5c22035"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/78a593e163e74a7b9db61133e5c22035"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/78a593e163e74a7b9db61133e5c22035"}]}] Jul 15 20:43:08.805647 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant: tempest-AttachVolumeNegativeTest-846080947 Jul 15 20:43:08.805647 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant-Id: 78a593e163e74a7b9db61133e5c22035 Jul 15 20:43:08.805647 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-846080947 Jul 15 20:43:08.805647 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User: tempest-AttachVolumeNegativeTest-846080947-project Jul 15 20:43:08.805647 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Domain-Id: default Jul 15 20:43:08.805647 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Domain-Name: Default Jul 15 20:43:08.805647 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Id: c0b5962b37b2470099436609425f7423 Jul 15 20:43:08.805647 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Name: tempest-AttachVolumeNegativeTest-846080947-project Jul 15 20:43:08.805647 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: method: > Jul 15 20:43:08.805647 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: exception: Instance 03bcc792-0b91-4282-a495-d8420a3602fc could not be found. Jul 15 20:43:08.805647 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: action_args: {'id': '03bcc792-0b91-4282-a495-d8420a3602fc'} Jul 15 20:43:08.806523 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 20:43:08.806523 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:43:08.806523 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 20:43:08.806523 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 20:43:08.806523 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 20:43:08.806523 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 20:43:08.806523 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 20:43:08.806523 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 20:43:08.806523 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 20:43:08.806523 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 20:43:08.806523 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03bcc792-0b91-4282-a495-d8420a3602fc could not be found. Jul 15 20:43:08.806523 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:43:08.806523 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:43:08.806523 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:43:08.806523 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:43:08.806523 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:43:08.806523 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:43:08.806523 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 20:43:08.806523 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 20:43:08.806523 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 20:43:08.807923 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 20:43:08.807923 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 20:43:08.807923 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 20:43:08.807923 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 20:43:08.807923 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 20:43:08.807923 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 20:43:08.807923 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 20:43:08.807923 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03bcc792-0b91-4282-a495-d8420a3602fc could not be found. Jul 15 20:43:08.807923 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:43:08.807923 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:43:08.807923 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:43:08.807923 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:43:08.807923 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:43:08.807923 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:43:08.807923 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 20:43:08.807923 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 20:43:08.807923 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03bcc792-0b91-4282-a495-d8420a3602fc could not be found. Jul 15 20:43:08.807923 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:43:08.809868 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-f7234b56-caeb-459c-89e5-10c14afa92ab tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Returning 404 to user: Instance 03bcc792-0b91-4282-a495-d8420a3602fc could not be found. {{(pid=124430) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 20:43:08.809868 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-f7234b56-caeb-459c-89e5-10c14afa92ab tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/03bcc792-0b91-4282-a495-d8420a3602fc" status: 404 len: 111 microversion: 2.1 time: 0.032392 Jul 15 20:43:08.809868 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 400/801] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:43:08 2022] GET /compute/v2.1/servers/03bcc792-0b91-4282-a495-d8420a3602fc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 20:43:09.761475 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-f506fbcc-5fda-4bee-9a87-517fc633f0a0 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:09.762145 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-f506fbcc-5fda-4bee-9a87-517fc633f0a0 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] [instance: b02f18ea-fd0b-4edd-97a7-17621ab67c8f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:09.768453 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f506fbcc-5fda-4bee-9a87-517fc633f0a0 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:09.768896 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f506fbcc-5fda-4bee-9a87-517fc633f0a0 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:09.769694 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f506fbcc-5fda-4bee-9a87-517fc633f0a0 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:09.770114 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f506fbcc-5fda-4bee-9a87-517fc633f0a0 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:09.904240 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-f506fbcc-5fda-4bee-9a87-517fc633f0a0 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e27fccbf854a8b8c9d6d099893f783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e1593c67704dbbafad13310ca35448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:09.911791 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-f506fbcc-5fda-4bee-9a87-517fc633f0a0 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] 10.222.0.66 "GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f" status: 200 len: 1567 microversion: 2.1 time: 0.154632 Jul 15 20:43:09.912352 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 402/802] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:43:09 2022] GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:43:09.941074 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-7ee9152c-5e60-4489-a3b0-230b76647dac tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:09.941581 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-7ee9152c-5e60-4489-a3b0-230b76647dac tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 4ffccc9e-10cc-413f-ac60-518d6541968a] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:09.947926 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-7ee9152c-5e60-4489-a3b0-230b76647dac tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:09.948371 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-7ee9152c-5e60-4489-a3b0-230b76647dac tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:09.949243 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-7ee9152c-5e60-4489-a3b0-230b76647dac tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:09.949588 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-7ee9152c-5e60-4489-a3b0-230b76647dac tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:09.962621 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.wsgi [None req-7ee9152c-5e60-4489-a3b0-230b76647dac tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] HTTP exception thrown: Instance 4ffccc9e-10cc-413f-ac60-518d6541968a could not be found. Jul 15 20:43:09.964133 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-7ee9152c-5e60-4489-a3b0-230b76647dac tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Request method failure captured: Jul 15 20:43:09.964133 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: request: DELETE /compute/v2.1/servers/4ffccc9e-10cc-413f-ac60-518d6541968a HTTP/1.1 Jul 15 20:43:09.964133 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Accept: application/json Jul 15 20:43:09.964133 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Accept-Encoding: identity Jul 15 20:43:09.964133 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Connection: close Jul 15 20:43:09.964133 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Content-Length: 0 Jul 15 20:43:09.964133 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Content-Type: application/json Jul 15 20:43:09.964133 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Host: 10.222.0.66 Jul 15 20:43:09.964133 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Openstack-System-Scope: None Jul 15 20:43:09.964133 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: User-Agent: python-urllib3/1.26.9 Jul 15 20:43:09.964133 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Auth-Token: gAAAAABi0c_kH9ys3aP35h1LWWw3r1ieyA8CI0v0WIPPxjHmBB6aGubC4LmfLrm23mJ8HvmdkzR7wDAmSNK2w9OIr-gnn6Blv4WbaRzcu_QA8HGYGiqbz987b1vb5xUWoBYf2fTfD1m5oPgbP0g7S9YRfksUIFxkz4MW4lkoTMD9FFmUr-jPyfM Jul 15 20:43:09.964133 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Domain-Id: None Jul 15 20:43:09.964133 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Domain-Name: None Jul 15 20:43:09.964133 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Identity-Status: Confirmed Jul 15 20:43:09.964133 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Is-Admin-Project: True Jul 15 20:43:09.964133 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Domain-Id: default Jul 15 20:43:09.964133 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Domain-Name: Default Jul 15 20:43:09.964133 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Id: 78a593e163e74a7b9db61133e5c22035 Jul 15 20:43:09.964133 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Name: tempest-AttachVolumeNegativeTest-846080947 Jul 15 20:43:09.964133 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Role: member,reader Jul 15 20:43:09.964133 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Roles: member,reader Jul 15 20:43:09.966089 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/78a593e163e74a7b9db61133e5c22035"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_78a593e163e74a7b9db61133e5c22035"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/78a593e163e74a7b9db61133e5c22035"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/78a593e163e74a7b9db61133e5c22035"}]}] Jul 15 20:43:09.966089 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant: tempest-AttachVolumeNegativeTest-846080947 Jul 15 20:43:09.966089 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant-Id: 78a593e163e74a7b9db61133e5c22035 Jul 15 20:43:09.966089 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-846080947 Jul 15 20:43:09.966089 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User: tempest-AttachVolumeNegativeTest-846080947-project Jul 15 20:43:09.966089 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Domain-Id: default Jul 15 20:43:09.966089 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Domain-Name: Default Jul 15 20:43:09.966089 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Id: c0b5962b37b2470099436609425f7423 Jul 15 20:43:09.966089 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Name: tempest-AttachVolumeNegativeTest-846080947-project Jul 15 20:43:09.966089 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: method: > Jul 15 20:43:09.966089 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: exception: Instance 4ffccc9e-10cc-413f-ac60-518d6541968a could not be found. Jul 15 20:43:09.966089 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: action_args: {'id': '4ffccc9e-10cc-413f-ac60-518d6541968a'} Jul 15 20:43:09.967133 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 20:43:09.967133 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:43:09.967133 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 20:43:09.967133 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 20:43:09.967133 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 20:43:09.967133 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 20:43:09.967133 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 20:43:09.967133 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 20:43:09.967133 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 20:43:09.967133 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 20:43:09.967133 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ffccc9e-10cc-413f-ac60-518d6541968a could not be found. Jul 15 20:43:09.967133 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:43:09.967133 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:43:09.967133 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:43:09.967133 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:43:09.967133 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:43:09.967133 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:43:09.967133 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 20:43:09.967133 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 20:43:09.967133 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 20:43:09.968938 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 20:43:09.968938 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 15 20:43:09.968938 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 15 20:43:09.968938 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 15 20:43:09.968938 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 15 20:43:09.968938 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 20:43:09.968938 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 20:43:09.968938 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 20:43:09.968938 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 20:43:09.968938 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ffccc9e-10cc-413f-ac60-518d6541968a could not be found. Jul 15 20:43:09.968938 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:43:09.968938 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:43:09.968938 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:43:09.968938 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:43:09.968938 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:43:09.968938 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:43:09.968938 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 20:43:09.968938 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 20:43:09.968938 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ffccc9e-10cc-413f-ac60-518d6541968a could not be found. Jul 15 20:43:09.968938 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:43:09.970576 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-7ee9152c-5e60-4489-a3b0-230b76647dac tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Returning 404 to user: Instance 4ffccc9e-10cc-413f-ac60-518d6541968a could not be found. {{(pid=124430) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 20:43:09.970576 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-7ee9152c-5e60-4489-a3b0-230b76647dac tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "DELETE /compute/v2.1/servers/4ffccc9e-10cc-413f-ac60-518d6541968a" status: 404 len: 111 microversion: 2.1 time: 0.028332 Jul 15 20:43:09.970576 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 401/803] 10.222.0.66 () {58 vars in 1238 bytes} [Fri Jul 15 20:43:09 2022] DELETE /compute/v2.1/servers/4ffccc9e-10cc-413f-ac60-518d6541968a => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 20:43:09.973732 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-6cac8c9b-afb6-4e40-b616-cf092952d857 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:09.974336 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-6cac8c9b-afb6-4e40-b616-cf092952d857 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 4ffccc9e-10cc-413f-ac60-518d6541968a] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:09.981052 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6cac8c9b-afb6-4e40-b616-cf092952d857 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:09.981688 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6cac8c9b-afb6-4e40-b616-cf092952d857 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:09.982446 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6cac8c9b-afb6-4e40-b616-cf092952d857 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:09.982884 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6cac8c9b-afb6-4e40-b616-cf092952d857 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:09.996285 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.wsgi [None req-6cac8c9b-afb6-4e40-b616-cf092952d857 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] HTTP exception thrown: Instance 4ffccc9e-10cc-413f-ac60-518d6541968a could not be found. Jul 15 20:43:09.997836 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-6cac8c9b-afb6-4e40-b616-cf092952d857 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Request method failure captured: Jul 15 20:43:09.997836 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: request: GET /compute/v2.1/servers/4ffccc9e-10cc-413f-ac60-518d6541968a HTTP/1.1 Jul 15 20:43:09.997836 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Accept: application/json Jul 15 20:43:09.997836 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Accept-Encoding: identity Jul 15 20:43:09.997836 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Connection: close Jul 15 20:43:09.997836 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Content-Length: 0 Jul 15 20:43:09.997836 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Content-Type: application/json Jul 15 20:43:09.997836 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Host: 10.222.0.66 Jul 15 20:43:09.997836 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Openstack-System-Scope: None Jul 15 20:43:09.997836 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: User-Agent: python-urllib3/1.26.9 Jul 15 20:43:09.997836 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Auth-Token: gAAAAABi0c_kH9ys3aP35h1LWWw3r1ieyA8CI0v0WIPPxjHmBB6aGubC4LmfLrm23mJ8HvmdkzR7wDAmSNK2w9OIr-gnn6Blv4WbaRzcu_QA8HGYGiqbz987b1vb5xUWoBYf2fTfD1m5oPgbP0g7S9YRfksUIFxkz4MW4lkoTMD9FFmUr-jPyfM Jul 15 20:43:09.997836 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Domain-Id: None Jul 15 20:43:09.997836 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Domain-Name: None Jul 15 20:43:09.997836 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Identity-Status: Confirmed Jul 15 20:43:09.997836 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Is-Admin-Project: True Jul 15 20:43:09.997836 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Domain-Id: default Jul 15 20:43:09.997836 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Domain-Name: Default Jul 15 20:43:09.997836 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Id: 78a593e163e74a7b9db61133e5c22035 Jul 15 20:43:09.997836 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Name: tempest-AttachVolumeNegativeTest-846080947 Jul 15 20:43:09.997836 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Role: member,reader Jul 15 20:43:09.997836 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Roles: member,reader Jul 15 20:43:09.999395 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/78a593e163e74a7b9db61133e5c22035"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_78a593e163e74a7b9db61133e5c22035"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/78a593e163e74a7b9db61133e5c22035"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/78a593e163e74a7b9db61133e5c22035"}]}] Jul 15 20:43:09.999395 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Tenant: tempest-AttachVolumeNegativeTest-846080947 Jul 15 20:43:09.999395 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Tenant-Id: 78a593e163e74a7b9db61133e5c22035 Jul 15 20:43:09.999395 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-846080947 Jul 15 20:43:09.999395 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User: tempest-AttachVolumeNegativeTest-846080947-project Jul 15 20:43:09.999395 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Domain-Id: default Jul 15 20:43:09.999395 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Domain-Name: Default Jul 15 20:43:09.999395 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Id: c0b5962b37b2470099436609425f7423 Jul 15 20:43:09.999395 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Name: tempest-AttachVolumeNegativeTest-846080947-project Jul 15 20:43:09.999395 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: method: > Jul 15 20:43:09.999395 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: exception: Instance 4ffccc9e-10cc-413f-ac60-518d6541968a could not be found. Jul 15 20:43:09.999395 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: action_args: {'id': '4ffccc9e-10cc-413f-ac60-518d6541968a'} Jul 15 20:43:10.000275 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 20:43:10.000275 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:43:10.000275 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 20:43:10.000275 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 20:43:10.000275 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 20:43:10.000275 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 20:43:10.000275 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 20:43:10.000275 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 20:43:10.000275 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 20:43:10.000275 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 20:43:10.000275 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ffccc9e-10cc-413f-ac60-518d6541968a could not be found. Jul 15 20:43:10.000275 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:43:10.000275 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:43:10.000275 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:43:10.000275 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:43:10.000275 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:43:10.000275 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:43:10.000275 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 20:43:10.000275 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 20:43:10.000275 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 20:43:10.001667 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 20:43:10.001667 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 20:43:10.001667 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 20:43:10.001667 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 20:43:10.001667 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 20:43:10.001667 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 20:43:10.001667 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 20:43:10.001667 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ffccc9e-10cc-413f-ac60-518d6541968a could not be found. Jul 15 20:43:10.001667 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:43:10.001667 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:43:10.001667 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:43:10.001667 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:43:10.001667 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:43:10.001667 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:43:10.001667 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 20:43:10.001667 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 20:43:10.001667 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ffccc9e-10cc-413f-ac60-518d6541968a could not be found. Jul 15 20:43:10.001667 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:43:10.002985 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-6cac8c9b-afb6-4e40-b616-cf092952d857 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Returning 404 to user: Instance 4ffccc9e-10cc-413f-ac60-518d6541968a could not be found. {{(pid=124432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 20:43:10.002985 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-6cac8c9b-afb6-4e40-b616-cf092952d857 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/4ffccc9e-10cc-413f-ac60-518d6541968a" status: 404 len: 111 microversion: 2.1 time: 0.029232 Jul 15 20:43:10.002985 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 403/804] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:43:09 2022] GET /compute/v2.1/servers/4ffccc9e-10cc-413f-ac60-518d6541968a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 20:43:10.007441 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-bb327c3f-9545-437d-8e1a-f1748dc12b6d tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:10.007933 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-bb327c3f-9545-437d-8e1a-f1748dc12b6d tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 0f5cb5b0-4308-42bf-9145-9d88bd8af17c] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:10.014123 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-bb327c3f-9545-437d-8e1a-f1748dc12b6d tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:10.014487 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-bb327c3f-9545-437d-8e1a-f1748dc12b6d tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:10.015240 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-bb327c3f-9545-437d-8e1a-f1748dc12b6d tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:10.015676 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-bb327c3f-9545-437d-8e1a-f1748dc12b6d tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:10.028772 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.wsgi [None req-bb327c3f-9545-437d-8e1a-f1748dc12b6d tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] HTTP exception thrown: Instance 0f5cb5b0-4308-42bf-9145-9d88bd8af17c could not be found. Jul 15 20:43:10.030274 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-bb327c3f-9545-437d-8e1a-f1748dc12b6d tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Request method failure captured: Jul 15 20:43:10.030274 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: request: DELETE /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c HTTP/1.1 Jul 15 20:43:10.030274 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Accept: application/json Jul 15 20:43:10.030274 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Accept-Encoding: identity Jul 15 20:43:10.030274 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Connection: close Jul 15 20:43:10.030274 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Content-Length: 0 Jul 15 20:43:10.030274 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Content-Type: application/json Jul 15 20:43:10.030274 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Host: 10.222.0.66 Jul 15 20:43:10.030274 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Openstack-System-Scope: None Jul 15 20:43:10.030274 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: User-Agent: python-urllib3/1.26.9 Jul 15 20:43:10.030274 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Auth-Token: gAAAAABi0c_kH9ys3aP35h1LWWw3r1ieyA8CI0v0WIPPxjHmBB6aGubC4LmfLrm23mJ8HvmdkzR7wDAmSNK2w9OIr-gnn6Blv4WbaRzcu_QA8HGYGiqbz987b1vb5xUWoBYf2fTfD1m5oPgbP0g7S9YRfksUIFxkz4MW4lkoTMD9FFmUr-jPyfM Jul 15 20:43:10.030274 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Domain-Id: None Jul 15 20:43:10.030274 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Domain-Name: None Jul 15 20:43:10.030274 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Identity-Status: Confirmed Jul 15 20:43:10.030274 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Is-Admin-Project: True Jul 15 20:43:10.030274 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Domain-Id: default Jul 15 20:43:10.030274 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Domain-Name: Default Jul 15 20:43:10.030274 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Id: 78a593e163e74a7b9db61133e5c22035 Jul 15 20:43:10.030274 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Name: tempest-AttachVolumeNegativeTest-846080947 Jul 15 20:43:10.030274 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Role: member,reader Jul 15 20:43:10.030274 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Roles: member,reader Jul 15 20:43:10.031859 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/78a593e163e74a7b9db61133e5c22035"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_78a593e163e74a7b9db61133e5c22035"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/78a593e163e74a7b9db61133e5c22035"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/78a593e163e74a7b9db61133e5c22035"}]}] Jul 15 20:43:10.031859 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant: tempest-AttachVolumeNegativeTest-846080947 Jul 15 20:43:10.031859 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant-Id: 78a593e163e74a7b9db61133e5c22035 Jul 15 20:43:10.031859 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-846080947 Jul 15 20:43:10.031859 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User: tempest-AttachVolumeNegativeTest-846080947-project Jul 15 20:43:10.031859 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Domain-Id: default Jul 15 20:43:10.031859 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Domain-Name: Default Jul 15 20:43:10.031859 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Id: c0b5962b37b2470099436609425f7423 Jul 15 20:43:10.031859 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Name: tempest-AttachVolumeNegativeTest-846080947-project Jul 15 20:43:10.031859 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: method: > Jul 15 20:43:10.031859 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: exception: Instance 0f5cb5b0-4308-42bf-9145-9d88bd8af17c could not be found. Jul 15 20:43:10.031859 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: action_args: {'id': '0f5cb5b0-4308-42bf-9145-9d88bd8af17c'} Jul 15 20:43:10.032680 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 20:43:10.032680 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:43:10.032680 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 20:43:10.032680 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 20:43:10.032680 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 20:43:10.032680 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 20:43:10.032680 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 20:43:10.032680 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 20:43:10.032680 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 20:43:10.032680 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 20:43:10.032680 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f5cb5b0-4308-42bf-9145-9d88bd8af17c could not be found. Jul 15 20:43:10.032680 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:43:10.032680 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:43:10.032680 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:43:10.032680 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:43:10.032680 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:43:10.032680 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:43:10.032680 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 20:43:10.032680 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 20:43:10.032680 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 20:43:10.033944 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 20:43:10.033944 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 15 20:43:10.033944 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 15 20:43:10.033944 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 15 20:43:10.033944 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 15 20:43:10.033944 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 20:43:10.033944 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 20:43:10.033944 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 20:43:10.033944 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 20:43:10.033944 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f5cb5b0-4308-42bf-9145-9d88bd8af17c could not be found. Jul 15 20:43:10.033944 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:43:10.033944 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:43:10.033944 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:43:10.033944 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:43:10.033944 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:43:10.033944 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:43:10.033944 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 20:43:10.033944 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 20:43:10.033944 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f5cb5b0-4308-42bf-9145-9d88bd8af17c could not be found. Jul 15 20:43:10.033944 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:43:10.035184 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-bb327c3f-9545-437d-8e1a-f1748dc12b6d tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Returning 404 to user: Instance 0f5cb5b0-4308-42bf-9145-9d88bd8af17c could not be found. {{(pid=124430) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 20:43:10.035184 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-bb327c3f-9545-437d-8e1a-f1748dc12b6d tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "DELETE /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c" status: 404 len: 111 microversion: 2.1 time: 0.027988 Jul 15 20:43:10.035184 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 402/805] 10.222.0.66 () {58 vars in 1238 bytes} [Fri Jul 15 20:43:10 2022] DELETE /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 15 20:43:10.040360 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-1035cf81-0d91-47c4-b40d-b13b74f4e41f tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:10.040985 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-1035cf81-0d91-47c4-b40d-b13b74f4e41f tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: 0f5cb5b0-4308-42bf-9145-9d88bd8af17c] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:10.047548 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1035cf81-0d91-47c4-b40d-b13b74f4e41f tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:10.047988 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1035cf81-0d91-47c4-b40d-b13b74f4e41f tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:10.048800 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1035cf81-0d91-47c4-b40d-b13b74f4e41f tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:10.049231 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1035cf81-0d91-47c4-b40d-b13b74f4e41f tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:10.062740 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.wsgi [None req-1035cf81-0d91-47c4-b40d-b13b74f4e41f tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] HTTP exception thrown: Instance 0f5cb5b0-4308-42bf-9145-9d88bd8af17c could not be found. Jul 15 20:43:10.064218 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-1035cf81-0d91-47c4-b40d-b13b74f4e41f tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Request method failure captured: Jul 15 20:43:10.064218 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: request: GET /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c HTTP/1.1 Jul 15 20:43:10.064218 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Accept: application/json Jul 15 20:43:10.064218 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Accept-Encoding: identity Jul 15 20:43:10.064218 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Connection: close Jul 15 20:43:10.064218 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Content-Length: 0 Jul 15 20:43:10.064218 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Content-Type: application/json Jul 15 20:43:10.064218 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Host: 10.222.0.66 Jul 15 20:43:10.064218 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Openstack-System-Scope: None Jul 15 20:43:10.064218 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: User-Agent: python-urllib3/1.26.9 Jul 15 20:43:10.064218 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Auth-Token: gAAAAABi0c_kH9ys3aP35h1LWWw3r1ieyA8CI0v0WIPPxjHmBB6aGubC4LmfLrm23mJ8HvmdkzR7wDAmSNK2w9OIr-gnn6Blv4WbaRzcu_QA8HGYGiqbz987b1vb5xUWoBYf2fTfD1m5oPgbP0g7S9YRfksUIFxkz4MW4lkoTMD9FFmUr-jPyfM Jul 15 20:43:10.064218 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Domain-Id: None Jul 15 20:43:10.064218 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Domain-Name: None Jul 15 20:43:10.064218 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Identity-Status: Confirmed Jul 15 20:43:10.064218 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Is-Admin-Project: True Jul 15 20:43:10.064218 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Domain-Id: default Jul 15 20:43:10.064218 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Domain-Name: Default Jul 15 20:43:10.064218 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Id: 78a593e163e74a7b9db61133e5c22035 Jul 15 20:43:10.064218 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Name: tempest-AttachVolumeNegativeTest-846080947 Jul 15 20:43:10.064218 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Role: member,reader Jul 15 20:43:10.064218 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Roles: member,reader Jul 15 20:43:10.065812 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/78a593e163e74a7b9db61133e5c22035"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_78a593e163e74a7b9db61133e5c22035"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/78a593e163e74a7b9db61133e5c22035"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/78a593e163e74a7b9db61133e5c22035"}]}] Jul 15 20:43:10.065812 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Tenant: tempest-AttachVolumeNegativeTest-846080947 Jul 15 20:43:10.065812 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Tenant-Id: 78a593e163e74a7b9db61133e5c22035 Jul 15 20:43:10.065812 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-846080947 Jul 15 20:43:10.065812 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User: tempest-AttachVolumeNegativeTest-846080947-project Jul 15 20:43:10.065812 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Domain-Id: default Jul 15 20:43:10.065812 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Domain-Name: Default Jul 15 20:43:10.065812 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Id: c0b5962b37b2470099436609425f7423 Jul 15 20:43:10.065812 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Name: tempest-AttachVolumeNegativeTest-846080947-project Jul 15 20:43:10.065812 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: method: > Jul 15 20:43:10.065812 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: exception: Instance 0f5cb5b0-4308-42bf-9145-9d88bd8af17c could not be found. Jul 15 20:43:10.065812 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: action_args: {'id': '0f5cb5b0-4308-42bf-9145-9d88bd8af17c'} Jul 15 20:43:10.066766 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 20:43:10.066766 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:43:10.066766 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 20:43:10.066766 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 20:43:10.066766 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 20:43:10.066766 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 20:43:10.066766 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 20:43:10.066766 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 20:43:10.066766 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 20:43:10.066766 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 20:43:10.066766 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f5cb5b0-4308-42bf-9145-9d88bd8af17c could not be found. Jul 15 20:43:10.066766 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:43:10.066766 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:43:10.066766 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:43:10.066766 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:43:10.066766 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:43:10.066766 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:43:10.066766 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 20:43:10.066766 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 20:43:10.066766 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 20:43:10.068217 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 20:43:10.068217 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 20:43:10.068217 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 20:43:10.068217 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 20:43:10.068217 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 20:43:10.068217 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 20:43:10.068217 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 20:43:10.068217 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f5cb5b0-4308-42bf-9145-9d88bd8af17c could not be found. Jul 15 20:43:10.068217 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:43:10.068217 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:43:10.068217 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:43:10.068217 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:43:10.068217 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:43:10.068217 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:43:10.068217 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 20:43:10.068217 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 20:43:10.068217 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f5cb5b0-4308-42bf-9145-9d88bd8af17c could not be found. Jul 15 20:43:10.068217 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:43:10.069730 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-1035cf81-0d91-47c4-b40d-b13b74f4e41f tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Returning 404 to user: Instance 0f5cb5b0-4308-42bf-9145-9d88bd8af17c could not be found. {{(pid=124432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 20:43:10.069730 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-1035cf81-0d91-47c4-b40d-b13b74f4e41f tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c" status: 404 len: 111 microversion: 2.1 time: 0.029229 Jul 15 20:43:10.069730 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 404/806] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:43:10 2022] GET /compute/v2.1/servers/0f5cb5b0-4308-42bf-9145-9d88bd8af17c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 20:43:10.930067 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-b9572853-b383-43dc-8d9a-1bb9551d5648 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:10.930597 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-b9572853-b383-43dc-8d9a-1bb9551d5648 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] [instance: b02f18ea-fd0b-4edd-97a7-17621ab67c8f] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:10.936996 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b9572853-b383-43dc-8d9a-1bb9551d5648 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:10.937446 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b9572853-b383-43dc-8d9a-1bb9551d5648 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:10.938214 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b9572853-b383-43dc-8d9a-1bb9551d5648 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:10.938695 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b9572853-b383-43dc-8d9a-1bb9551d5648 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:11.069776 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-b9572853-b383-43dc-8d9a-1bb9551d5648 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e27fccbf854a8b8c9d6d099893f783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e1593c67704dbbafad13310ca35448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:11.077954 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-b9572853-b383-43dc-8d9a-1bb9551d5648 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] 10.222.0.66 "GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f" status: 200 len: 1567 microversion: 2.1 time: 0.151898 Jul 15 20:43:11.078581 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 403/807] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:43:10 2022] GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:43:11.199370 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-8768bac5-a723-4bc5-a682-ddaf8a078d65 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:11.200136 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-8768bac5-a723-4bc5-a682-ddaf8a078d65 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: f45998cc-d9ed-4dd5-acf0-caba5d56696d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:11.206755 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8768bac5-a723-4bc5-a682-ddaf8a078d65 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:11.207202 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8768bac5-a723-4bc5-a682-ddaf8a078d65 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:11.207962 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8768bac5-a723-4bc5-a682-ddaf8a078d65 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:11.208417 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8768bac5-a723-4bc5-a682-ddaf8a078d65 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:11.222526 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.wsgi [None req-8768bac5-a723-4bc5-a682-ddaf8a078d65 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] HTTP exception thrown: Instance f45998cc-d9ed-4dd5-acf0-caba5d56696d could not be found. Jul 15 20:43:11.224057 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-8768bac5-a723-4bc5-a682-ddaf8a078d65 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Request method failure captured: Jul 15 20:43:11.224057 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: request: DELETE /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d HTTP/1.1 Jul 15 20:43:11.224057 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Accept: application/json Jul 15 20:43:11.224057 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Accept-Encoding: identity Jul 15 20:43:11.224057 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Connection: close Jul 15 20:43:11.224057 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Content-Length: 0 Jul 15 20:43:11.224057 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Content-Type: application/json Jul 15 20:43:11.224057 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Host: 10.222.0.66 Jul 15 20:43:11.224057 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Openstack-System-Scope: None Jul 15 20:43:11.224057 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: User-Agent: python-urllib3/1.26.9 Jul 15 20:43:11.224057 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Auth-Token: gAAAAABi0c_kH9ys3aP35h1LWWw3r1ieyA8CI0v0WIPPxjHmBB6aGubC4LmfLrm23mJ8HvmdkzR7wDAmSNK2w9OIr-gnn6Blv4WbaRzcu_QA8HGYGiqbz987b1vb5xUWoBYf2fTfD1m5oPgbP0g7S9YRfksUIFxkz4MW4lkoTMD9FFmUr-jPyfM Jul 15 20:43:11.224057 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Domain-Id: None Jul 15 20:43:11.224057 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Domain-Name: None Jul 15 20:43:11.224057 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Identity-Status: Confirmed Jul 15 20:43:11.224057 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Is-Admin-Project: True Jul 15 20:43:11.224057 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Domain-Id: default Jul 15 20:43:11.224057 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Domain-Name: Default Jul 15 20:43:11.224057 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Id: 78a593e163e74a7b9db61133e5c22035 Jul 15 20:43:11.224057 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Name: tempest-AttachVolumeNegativeTest-846080947 Jul 15 20:43:11.224057 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Role: member,reader Jul 15 20:43:11.224057 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Roles: member,reader Jul 15 20:43:11.225429 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/78a593e163e74a7b9db61133e5c22035"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_78a593e163e74a7b9db61133e5c22035"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/78a593e163e74a7b9db61133e5c22035"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/78a593e163e74a7b9db61133e5c22035"}]}] Jul 15 20:43:11.225429 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Tenant: tempest-AttachVolumeNegativeTest-846080947 Jul 15 20:43:11.225429 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Tenant-Id: 78a593e163e74a7b9db61133e5c22035 Jul 15 20:43:11.225429 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-846080947 Jul 15 20:43:11.225429 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User: tempest-AttachVolumeNegativeTest-846080947-project Jul 15 20:43:11.225429 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Domain-Id: default Jul 15 20:43:11.225429 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Domain-Name: Default Jul 15 20:43:11.225429 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Id: c0b5962b37b2470099436609425f7423 Jul 15 20:43:11.225429 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Name: tempest-AttachVolumeNegativeTest-846080947-project Jul 15 20:43:11.225429 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: method: > Jul 15 20:43:11.225429 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: exception: Instance f45998cc-d9ed-4dd5-acf0-caba5d56696d could not be found. Jul 15 20:43:11.225429 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: action_args: {'id': 'f45998cc-d9ed-4dd5-acf0-caba5d56696d'} Jul 15 20:43:11.226209 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 20:43:11.226209 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:43:11.226209 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 20:43:11.226209 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 20:43:11.226209 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 20:43:11.226209 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 20:43:11.226209 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 20:43:11.226209 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 20:43:11.226209 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 20:43:11.226209 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 20:43:11.226209 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f45998cc-d9ed-4dd5-acf0-caba5d56696d could not be found. Jul 15 20:43:11.226209 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:43:11.226209 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:43:11.226209 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:43:11.226209 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:43:11.226209 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:43:11.226209 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:43:11.226209 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 20:43:11.226209 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 20:43:11.226209 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 20:43:11.227750 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 20:43:11.227750 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 15 20:43:11.227750 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 15 20:43:11.227750 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 15 20:43:11.227750 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 15 20:43:11.227750 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 20:43:11.227750 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 20:43:11.227750 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 20:43:11.227750 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 20:43:11.227750 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f45998cc-d9ed-4dd5-acf0-caba5d56696d could not be found. Jul 15 20:43:11.227750 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:43:11.227750 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:43:11.227750 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:43:11.227750 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:43:11.227750 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:43:11.227750 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:43:11.227750 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 20:43:11.227750 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 20:43:11.227750 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f45998cc-d9ed-4dd5-acf0-caba5d56696d could not be found. Jul 15 20:43:11.227750 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:43:11.229716 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-8768bac5-a723-4bc5-a682-ddaf8a078d65 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Returning 404 to user: Instance f45998cc-d9ed-4dd5-acf0-caba5d56696d could not be found. {{(pid=124432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 20:43:11.229716 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-8768bac5-a723-4bc5-a682-ddaf8a078d65 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "DELETE /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d" status: 404 len: 111 microversion: 2.1 time: 0.030549 Jul 15 20:43:11.229716 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 405/808] 10.222.0.66 () {58 vars in 1238 bytes} [Fri Jul 15 20:43:11 2022] DELETE /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 20:43:11.234338 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-42f9c507-6da3-4408-9edc-cc8d197114b8 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:11.234978 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-42f9c507-6da3-4408-9edc-cc8d197114b8 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] [instance: f45998cc-d9ed-4dd5-acf0-caba5d56696d] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:11.240990 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-42f9c507-6da3-4408-9edc-cc8d197114b8 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:11.241440 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-42f9c507-6da3-4408-9edc-cc8d197114b8 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:11.242189 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-42f9c507-6da3-4408-9edc-cc8d197114b8 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:11.242629 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-42f9c507-6da3-4408-9edc-cc8d197114b8 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:11.256000 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.wsgi [None req-42f9c507-6da3-4408-9edc-cc8d197114b8 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] HTTP exception thrown: Instance f45998cc-d9ed-4dd5-acf0-caba5d56696d could not be found. Jul 15 20:43:11.257517 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-42f9c507-6da3-4408-9edc-cc8d197114b8 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Request method failure captured: Jul 15 20:43:11.257517 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: request: GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d HTTP/1.1 Jul 15 20:43:11.257517 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Accept: application/json Jul 15 20:43:11.257517 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Accept-Encoding: identity Jul 15 20:43:11.257517 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Connection: close Jul 15 20:43:11.257517 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Content-Length: 0 Jul 15 20:43:11.257517 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Content-Type: application/json Jul 15 20:43:11.257517 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Host: 10.222.0.66 Jul 15 20:43:11.257517 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Openstack-System-Scope: None Jul 15 20:43:11.257517 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: User-Agent: python-urllib3/1.26.9 Jul 15 20:43:11.257517 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Auth-Token: gAAAAABi0c_kH9ys3aP35h1LWWw3r1ieyA8CI0v0WIPPxjHmBB6aGubC4LmfLrm23mJ8HvmdkzR7wDAmSNK2w9OIr-gnn6Blv4WbaRzcu_QA8HGYGiqbz987b1vb5xUWoBYf2fTfD1m5oPgbP0g7S9YRfksUIFxkz4MW4lkoTMD9FFmUr-jPyfM Jul 15 20:43:11.257517 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Domain-Id: None Jul 15 20:43:11.257517 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Domain-Name: None Jul 15 20:43:11.257517 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Identity-Status: Confirmed Jul 15 20:43:11.257517 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Is-Admin-Project: True Jul 15 20:43:11.257517 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Domain-Id: default Jul 15 20:43:11.257517 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Domain-Name: Default Jul 15 20:43:11.257517 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Id: 78a593e163e74a7b9db61133e5c22035 Jul 15 20:43:11.257517 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Name: tempest-AttachVolumeNegativeTest-846080947 Jul 15 20:43:11.257517 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Role: member,reader Jul 15 20:43:11.257517 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Roles: member,reader Jul 15 20:43:11.259052 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/78a593e163e74a7b9db61133e5c22035"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_78a593e163e74a7b9db61133e5c22035"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/78a593e163e74a7b9db61133e5c22035"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/78a593e163e74a7b9db61133e5c22035"}]}] Jul 15 20:43:11.259052 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant: tempest-AttachVolumeNegativeTest-846080947 Jul 15 20:43:11.259052 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant-Id: 78a593e163e74a7b9db61133e5c22035 Jul 15 20:43:11.259052 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-846080947 Jul 15 20:43:11.259052 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User: tempest-AttachVolumeNegativeTest-846080947-project Jul 15 20:43:11.259052 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Domain-Id: default Jul 15 20:43:11.259052 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Domain-Name: Default Jul 15 20:43:11.259052 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Id: c0b5962b37b2470099436609425f7423 Jul 15 20:43:11.259052 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Name: tempest-AttachVolumeNegativeTest-846080947-project Jul 15 20:43:11.259052 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: method: > Jul 15 20:43:11.259052 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: exception: Instance f45998cc-d9ed-4dd5-acf0-caba5d56696d could not be found. Jul 15 20:43:11.259052 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: action_args: {'id': 'f45998cc-d9ed-4dd5-acf0-caba5d56696d'} Jul 15 20:43:11.260284 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 20:43:11.260284 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:43:11.260284 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 20:43:11.260284 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 20:43:11.260284 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 20:43:11.260284 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 20:43:11.260284 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 20:43:11.260284 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 20:43:11.260284 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 20:43:11.260284 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 20:43:11.260284 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f45998cc-d9ed-4dd5-acf0-caba5d56696d could not be found. Jul 15 20:43:11.260284 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:43:11.260284 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:43:11.260284 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:43:11.260284 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:43:11.260284 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:43:11.260284 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:43:11.260284 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 20:43:11.260284 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 20:43:11.260284 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 20:43:11.262599 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 20:43:11.262599 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 20:43:11.262599 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 20:43:11.262599 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 20:43:11.262599 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 20:43:11.262599 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 20:43:11.262599 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 20:43:11.262599 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f45998cc-d9ed-4dd5-acf0-caba5d56696d could not be found. Jul 15 20:43:11.262599 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:43:11.262599 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:43:11.262599 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:43:11.262599 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:43:11.262599 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:43:11.262599 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:43:11.262599 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 20:43:11.262599 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 20:43:11.262599 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f45998cc-d9ed-4dd5-acf0-caba5d56696d could not be found. Jul 15 20:43:11.262599 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:43:11.264809 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-42f9c507-6da3-4408-9edc-cc8d197114b8 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] Returning 404 to user: Instance f45998cc-d9ed-4dd5-acf0-caba5d56696d could not be found. {{(pid=124430) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 20:43:11.264809 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-42f9c507-6da3-4408-9edc-cc8d197114b8 tempest-AttachVolumeNegativeTest-846080947 tempest-AttachVolumeNegativeTest-846080947-project] 10.222.0.66 "GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d" status: 404 len: 111 microversion: 2.1 time: 0.028903 Jul 15 20:43:11.264809 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 404/809] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:43:11 2022] GET /compute/v2.1/servers/f45998cc-d9ed-4dd5-acf0-caba5d56696d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 15 20:43:12.095656 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-95d05fd2-626c-4670-8e1b-a106331b10f1 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:12.095984 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-95d05fd2-626c-4670-8e1b-a106331b10f1 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] [instance: b02f18ea-fd0b-4edd-97a7-17621ab67c8f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:12.102562 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-95d05fd2-626c-4670-8e1b-a106331b10f1 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:12.103016 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-95d05fd2-626c-4670-8e1b-a106331b10f1 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:12.103797 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-95d05fd2-626c-4670-8e1b-a106331b10f1 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:12.104231 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-95d05fd2-626c-4670-8e1b-a106331b10f1 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:12.310577 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-95d05fd2-626c-4670-8e1b-a106331b10f1 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e27fccbf854a8b8c9d6d099893f783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e1593c67704dbbafad13310ca35448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:12.318088 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-95d05fd2-626c-4670-8e1b-a106331b10f1 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] 10.222.0.66 "GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f" status: 200 len: 1567 microversion: 2.1 time: 0.226604 Jul 15 20:43:12.318653 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 406/810] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:43:12 2022] GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f => generated 1567 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:43:13.335257 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-3d4b4b26-434a-40ca-bf10-e9dcb51a1d17 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:13.336040 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-3d4b4b26-434a-40ca-bf10-e9dcb51a1d17 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] [instance: b02f18ea-fd0b-4edd-97a7-17621ab67c8f] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:13.344269 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-3d4b4b26-434a-40ca-bf10-e9dcb51a1d17 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:13.345032 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-3d4b4b26-434a-40ca-bf10-e9dcb51a1d17 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:13.345898 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-3d4b4b26-434a-40ca-bf10-e9dcb51a1d17 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:13.346604 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-3d4b4b26-434a-40ca-bf10-e9dcb51a1d17 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:13.565909 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-3d4b4b26-434a-40ca-bf10-e9dcb51a1d17 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e27fccbf854a8b8c9d6d099893f783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e1593c67704dbbafad13310ca35448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:13.574668 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-3d4b4b26-434a-40ca-bf10-e9dcb51a1d17 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] 10.222.0.66 "GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f" status: 200 len: 1567 microversion: 2.1 time: 0.242680 Jul 15 20:43:13.575888 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 405/811] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:43:13 2022] GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f => generated 1567 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:43:14.594098 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-c7865a88-4a53-4c58-9eb0-dd0f8bb8785f tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:14.594890 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-c7865a88-4a53-4c58-9eb0-dd0f8bb8785f tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] [instance: b02f18ea-fd0b-4edd-97a7-17621ab67c8f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:14.601836 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c7865a88-4a53-4c58-9eb0-dd0f8bb8785f tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:14.602188 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c7865a88-4a53-4c58-9eb0-dd0f8bb8785f tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:14.602968 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c7865a88-4a53-4c58-9eb0-dd0f8bb8785f tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:14.603409 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c7865a88-4a53-4c58-9eb0-dd0f8bb8785f tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:14.744312 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-c7865a88-4a53-4c58-9eb0-dd0f8bb8785f tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e27fccbf854a8b8c9d6d099893f783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e1593c67704dbbafad13310ca35448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:14.752693 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-c7865a88-4a53-4c58-9eb0-dd0f8bb8785f tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] 10.222.0.66 "GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f" status: 200 len: 1567 microversion: 2.1 time: 0.163874 Jul 15 20:43:14.753348 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 407/812] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:43:14 2022] GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:43:15.769280 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-05f64a8c-c1fc-4ea9-bd14-d11be9cc6885 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:15.769919 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-05f64a8c-c1fc-4ea9-bd14-d11be9cc6885 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] [instance: b02f18ea-fd0b-4edd-97a7-17621ab67c8f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:15.776365 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-05f64a8c-c1fc-4ea9-bd14-d11be9cc6885 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:15.777344 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-05f64a8c-c1fc-4ea9-bd14-d11be9cc6885 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:15.778139 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-05f64a8c-c1fc-4ea9-bd14-d11be9cc6885 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:15.778586 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-05f64a8c-c1fc-4ea9-bd14-d11be9cc6885 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:15.825420 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-b75715a4-93ab-43d0-a678-db881798922e tempest-VolumesSnapshotsTestJSON-1729836074 tempest-VolumesSnapshotsTestJSON-1729836074-project] Action: 'create', calling method: .version_select at 0x7ff5181941f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1635309265"}} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:43:15.916636 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-05f64a8c-c1fc-4ea9-bd14-d11be9cc6885 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e27fccbf854a8b8c9d6d099893f783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e1593c67704dbbafad13310ca35448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:15.924815 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-05f64a8c-c1fc-4ea9-bd14-d11be9cc6885 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] 10.222.0.66 "GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f" status: 200 len: 1567 microversion: 2.1 time: 0.159317 Jul 15 20:43:15.925390 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 408/813] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:43:15 2022] GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:43:16.113964 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-b75715a4-93ab-43d0-a678-db881798922e tempest-VolumesSnapshotsTestJSON-1729836074 tempest-VolumesSnapshotsTestJSON-1729836074-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.406356 Jul 15 20:43:16.114580 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 406/814] 10.222.0.66 () {60 vars in 1154 bytes} [Fri Jul 15 20:43:15 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 408 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 15 20:43:16.125544 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-90a77115-7930-40c7-aba5-ee7d33374f17 tempest-VolumesSnapshotsTestJSON-1729836074 tempest-VolumesSnapshotsTestJSON-1729836074-project] Calling method '.version_select at 0x7ff518110b80>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:16.175183 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-90a77115-7930-40c7-aba5-ee7d33374f17 tempest-VolumesSnapshotsTestJSON-1729836074 tempest-VolumesSnapshotsTestJSON-1729836074-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/c6089382-cec3-4a7e-9fc0-7083aea1015d" status: 200 len: 345 microversion: 2.1 time: 0.053473 Jul 15 20:43:16.175752 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 409/815] 10.222.0.66 () {58 vars in 1244 bytes} [Fri Jul 15 20:43:16 2022] GET /compute/v2.1/os-volumes/c6089382-cec3-4a7e-9fc0-7083aea1015d => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:43:16.942850 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-85784d90-aadd-4fb3-b573-04458c0abaf9 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:16.943431 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-85784d90-aadd-4fb3-b573-04458c0abaf9 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] [instance: b02f18ea-fd0b-4edd-97a7-17621ab67c8f] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:16.945497 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:43:16.952295 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-85784d90-aadd-4fb3-b573-04458c0abaf9 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:16.952780 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-85784d90-aadd-4fb3-b573-04458c0abaf9 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:16.953538 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-85784d90-aadd-4fb3-b573-04458c0abaf9 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:16.954002 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-85784d90-aadd-4fb3-b573-04458c0abaf9 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:17.082952 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-85784d90-aadd-4fb3-b573-04458c0abaf9 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e27fccbf854a8b8c9d6d099893f783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e1593c67704dbbafad13310ca35448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:17.090828 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-85784d90-aadd-4fb3-b573-04458c0abaf9 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] 10.222.0.66 "GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f" status: 200 len: 1567 microversion: 2.1 time: 0.152279 Jul 15 20:43:17.091386 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 407/816] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:43:16 2022] GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:43:17.187795 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-e0ddc31f-c9ae-41fb-b5ee-86b00f635eb7 tempest-VolumesSnapshotsTestJSON-1729836074 tempest-VolumesSnapshotsTestJSON-1729836074-project] Calling method '.version_select at 0x7ff518217d30>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:17.240801 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-e0ddc31f-c9ae-41fb-b5ee-86b00f635eb7 tempest-VolumesSnapshotsTestJSON-1729836074 tempest-VolumesSnapshotsTestJSON-1729836074-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/c6089382-cec3-4a7e-9fc0-7083aea1015d" status: 200 len: 346 microversion: 2.1 time: 0.057670 Jul 15 20:43:17.241368 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 410/817] 10.222.0.66 () {58 vars in 1244 bytes} [Fri Jul 15 20:43:17 2022] GET /compute/v2.1/os-volumes/c6089382-cec3-4a7e-9fc0-7083aea1015d => generated 346 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:43:17.252925 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-2c1e3113-3af8-4efc-b6c9-1dd11facf2a3 tempest-VolumesSnapshotsTestJSON-1729836074 tempest-VolumesSnapshotsTestJSON-1729836074-project] Action: 'create', calling method: .version_select at 0x7ff518271ee0>, body: {"snapshot": {"volume_id": "c6089382-cec3-4a7e-9fc0-7083aea1015d", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1019374109"}} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:43:17.400634 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-2c1e3113-3af8-4efc-b6c9-1dd11facf2a3 tempest-VolumesSnapshotsTestJSON-1729836074 tempest-VolumesSnapshotsTestJSON-1729836074-project] 10.222.0.66 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.151329 Jul 15 20:43:17.401298 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 408/818] 10.222.0.66 () {60 vars in 1161 bytes} [Fri Jul 15 20:43:17 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:43:17.411005 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-2a0c03ca-edc2-45af-9d26-7980996ad85d tempest-VolumesSnapshotsTestJSON-1729836074 tempest-VolumesSnapshotsTestJSON-1729836074-project] Calling method '.version_select at 0x7ff51803c670>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:17.442447 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-2a0c03ca-edc2-45af-9d26-7980996ad85d tempest-VolumesSnapshotsTestJSON-1729836074 tempest-VolumesSnapshotsTestJSON-1729836074-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/afebe470-3e81-4d29-acdc-6438b1b0558d" status: 200 len: 287 microversion: 2.1 time: 0.035062 Jul 15 20:43:17.443020 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 411/819] 10.222.0.66 () {58 vars in 1250 bytes} [Fri Jul 15 20:43:17 2022] GET /compute/v2.1/os-snapshots/afebe470-3e81-4d29-acdc-6438b1b0558d => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:43:17.453268 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-7e58febf-2c1d-4f25-abc4-9b1f3ad09902 tempest-VolumesSnapshotsTestJSON-1729836074 tempest-VolumesSnapshotsTestJSON-1729836074-project] Calling method '.version_select at 0x7ff51813adc0>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:17.483641 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-7e58febf-2c1d-4f25-abc4-9b1f3ad09902 tempest-VolumesSnapshotsTestJSON-1729836074 tempest-VolumesSnapshotsTestJSON-1729836074-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.034223 Jul 15 20:43:17.484208 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 409/820] 10.222.0.66 () {58 vars in 1139 bytes} [Fri Jul 15 20:43:17 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:43:17.494473 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-d1f806fe-58a9-478b-bac7-f226cc2048ae tempest-VolumesSnapshotsTestJSON-1729836074 tempest-VolumesSnapshotsTestJSON-1729836074-project] Calling method '.version_select at 0x7ff5181109d0>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:17.525175 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-d1f806fe-58a9-478b-bac7-f226cc2048ae tempest-VolumesSnapshotsTestJSON-1729836074 tempest-VolumesSnapshotsTestJSON-1729836074-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/afebe470-3e81-4d29-acdc-6438b1b0558d" status: 200 len: 287 microversion: 2.1 time: 0.034441 Jul 15 20:43:17.525742 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 412/821] 10.222.0.66 () {58 vars in 1250 bytes} [Fri Jul 15 20:43:17 2022] GET /compute/v2.1/os-snapshots/afebe470-3e81-4d29-acdc-6438b1b0558d => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:43:18.108644 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-ad510db8-f145-4bfa-ab2e-cf06a5f9868f tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:18.109239 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-ad510db8-f145-4bfa-ab2e-cf06a5f9868f tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] [instance: b02f18ea-fd0b-4edd-97a7-17621ab67c8f] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:18.116024 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-ad510db8-f145-4bfa-ab2e-cf06a5f9868f tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:18.116507 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-ad510db8-f145-4bfa-ab2e-cf06a5f9868f tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:18.117262 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-ad510db8-f145-4bfa-ab2e-cf06a5f9868f tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:18.117696 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-ad510db8-f145-4bfa-ab2e-cf06a5f9868f tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:18.249013 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-ad510db8-f145-4bfa-ab2e-cf06a5f9868f tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e27fccbf854a8b8c9d6d099893f783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e1593c67704dbbafad13310ca35448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:18.256377 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-ad510db8-f145-4bfa-ab2e-cf06a5f9868f tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] 10.222.0.66 "GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f" status: 200 len: 1567 microversion: 2.1 time: 0.152893 Jul 15 20:43:18.256954 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 410/822] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:43:18 2022] GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:43:18.538006 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-aa751a47-1ef1-4d1d-9297-e9cfe2e70c8c tempest-VolumesSnapshotsTestJSON-1729836074 tempest-VolumesSnapshotsTestJSON-1729836074-project] Calling method '.version_select at 0x7ff5180c7ee0>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:18.568687 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-aa751a47-1ef1-4d1d-9297-e9cfe2e70c8c tempest-VolumesSnapshotsTestJSON-1729836074 tempest-VolumesSnapshotsTestJSON-1729836074-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/afebe470-3e81-4d29-acdc-6438b1b0558d" status: 200 len: 287 microversion: 2.1 time: 0.034889 Jul 15 20:43:18.569255 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 413/823] 10.222.0.66 () {58 vars in 1250 bytes} [Fri Jul 15 20:43:18 2022] GET /compute/v2.1/os-snapshots/afebe470-3e81-4d29-acdc-6438b1b0558d => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:43:19.273974 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-2f867cdb-7feb-4ff8-9fe6-d2c97e381468 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:19.274587 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-2f867cdb-7feb-4ff8-9fe6-d2c97e381468 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] [instance: b02f18ea-fd0b-4edd-97a7-17621ab67c8f] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:19.282320 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-2f867cdb-7feb-4ff8-9fe6-d2c97e381468 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:19.282773 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-2f867cdb-7feb-4ff8-9fe6-d2c97e381468 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:19.283538 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-2f867cdb-7feb-4ff8-9fe6-d2c97e381468 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:19.283974 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-2f867cdb-7feb-4ff8-9fe6-d2c97e381468 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:19.416718 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-2f867cdb-7feb-4ff8-9fe6-d2c97e381468 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e27fccbf854a8b8c9d6d099893f783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e1593c67704dbbafad13310ca35448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:19.425655 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-2f867cdb-7feb-4ff8-9fe6-d2c97e381468 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] 10.222.0.66 "GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f" status: 200 len: 1567 microversion: 2.1 time: 0.155549 Jul 15 20:43:19.426324 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 411/824] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:43:19 2022] GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:43:19.581559 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-4da1e9d8-7b51-47b9-a913-c97df894fb02 tempest-VolumesSnapshotsTestJSON-1729836074 tempest-VolumesSnapshotsTestJSON-1729836074-project] Calling method '.version_select at 0x7ff5180f3b80>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:19.611649 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-4da1e9d8-7b51-47b9-a913-c97df894fb02 tempest-VolumesSnapshotsTestJSON-1729836074 tempest-VolumesSnapshotsTestJSON-1729836074-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/afebe470-3e81-4d29-acdc-6438b1b0558d" status: 200 len: 287 microversion: 2.1 time: 0.034561 Jul 15 20:43:19.612215 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 414/825] 10.222.0.66 () {58 vars in 1250 bytes} [Fri Jul 15 20:43:19 2022] GET /compute/v2.1/os-snapshots/afebe470-3e81-4d29-acdc-6438b1b0558d => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:43:20.442775 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-c340b32c-c75f-442a-b070-3c31d823f5f6 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:20.443455 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-c340b32c-c75f-442a-b070-3c31d823f5f6 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] [instance: b02f18ea-fd0b-4edd-97a7-17621ab67c8f] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:20.451032 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c340b32c-c75f-442a-b070-3c31d823f5f6 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:20.451507 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c340b32c-c75f-442a-b070-3c31d823f5f6 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:20.452282 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c340b32c-c75f-442a-b070-3c31d823f5f6 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:20.452742 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c340b32c-c75f-442a-b070-3c31d823f5f6 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:20.473963 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:43:20.593611 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-c340b32c-c75f-442a-b070-3c31d823f5f6 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e27fccbf854a8b8c9d6d099893f783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e1593c67704dbbafad13310ca35448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:20.601302 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-c340b32c-c75f-442a-b070-3c31d823f5f6 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] 10.222.0.66 "GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f" status: 200 len: 1567 microversion: 2.1 time: 0.162517 Jul 15 20:43:20.601860 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 412/826] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:43:20 2022] GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:43:20.624071 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-cc797f09-e75d-497c-a69e-4c28601eccf8 tempest-VolumesSnapshotsTestJSON-1729836074 tempest-VolumesSnapshotsTestJSON-1729836074-project] Calling method '.version_select at 0x7ff5180c7550>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:20.654773 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-cc797f09-e75d-497c-a69e-4c28601eccf8 tempest-VolumesSnapshotsTestJSON-1729836074 tempest-VolumesSnapshotsTestJSON-1729836074-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/afebe470-3e81-4d29-acdc-6438b1b0558d" status: 200 len: 288 microversion: 2.1 time: 0.035625 Jul 15 20:43:20.661046 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 415/827] 10.222.0.66 () {58 vars in 1250 bytes} [Fri Jul 15 20:43:20 2022] GET /compute/v2.1/os-snapshots/afebe470-3e81-4d29-acdc-6438b1b0558d => generated 288 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:43:20.666416 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-a5929932-7587-4321-887a-e46c32246a15 tempest-VolumesSnapshotsTestJSON-1729836074 tempest-VolumesSnapshotsTestJSON-1729836074-project] Calling method '.version_select at 0x7ff518194b80>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:20.727382 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-a5929932-7587-4321-887a-e46c32246a15 tempest-VolumesSnapshotsTestJSON-1729836074 tempest-VolumesSnapshotsTestJSON-1729836074-project] 10.222.0.66 "DELETE /compute/v2.1/os-snapshots/afebe470-3e81-4d29-acdc-6438b1b0558d" status: 202 len: 0 microversion: 2.1 time: 0.065087 Jul 15 20:43:20.728044 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 413/828] 10.222.0.66 () {58 vars in 1253 bytes} [Fri Jul 15 20:43:20 2022] DELETE /compute/v2.1/os-snapshots/afebe470-3e81-4d29-acdc-6438b1b0558d => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 20:43:20.736853 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-f1e2c4e3-c059-480b-985f-91c3c680fa62 tempest-VolumesSnapshotsTestJSON-1729836074 tempest-VolumesSnapshotsTestJSON-1729836074-project] Calling method '.version_select at 0x7ff51826c0d0>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:20.766503 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-f1e2c4e3-c059-480b-985f-91c3c680fa62 tempest-VolumesSnapshotsTestJSON-1729836074 tempest-VolumesSnapshotsTestJSON-1729836074-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/afebe470-3e81-4d29-acdc-6438b1b0558d" status: 200 len: 287 microversion: 2.1 time: 0.033354 Jul 15 20:43:20.767072 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 416/829] 10.222.0.66 () {58 vars in 1250 bytes} [Fri Jul 15 20:43:20 2022] GET /compute/v2.1/os-snapshots/afebe470-3e81-4d29-acdc-6438b1b0558d => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:43:21.619397 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-1b3869fa-5a98-4507-b8e0-3fc526db7f17 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:21.620002 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-1b3869fa-5a98-4507-b8e0-3fc526db7f17 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] [instance: b02f18ea-fd0b-4edd-97a7-17621ab67c8f] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:21.627041 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-1b3869fa-5a98-4507-b8e0-3fc526db7f17 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:21.627497 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-1b3869fa-5a98-4507-b8e0-3fc526db7f17 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:21.628253 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-1b3869fa-5a98-4507-b8e0-3fc526db7f17 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:21.628726 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-1b3869fa-5a98-4507-b8e0-3fc526db7f17 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:21.762200 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-1b3869fa-5a98-4507-b8e0-3fc526db7f17 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e27fccbf854a8b8c9d6d099893f783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e1593c67704dbbafad13310ca35448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:21.769774 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-1b3869fa-5a98-4507-b8e0-3fc526db7f17 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] 10.222.0.66 "GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f" status: 200 len: 1567 microversion: 2.1 time: 0.154856 Jul 15 20:43:21.770353 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 414/830] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:43:21 2022] GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:43:21.778569 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-3bf336d0-a6e1-45b1-8bde-30e64dc9f087 tempest-VolumesSnapshotsTestJSON-1729836074 tempest-VolumesSnapshotsTestJSON-1729836074-project] Calling method '.version_select at 0x7ff5180b7d30>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:21.803422 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.wsgi [None req-3bf336d0-a6e1-45b1-8bde-30e64dc9f087 tempest-VolumesSnapshotsTestJSON-1729836074 tempest-VolumesSnapshotsTestJSON-1729836074-project] HTTP exception thrown: Snapshot afebe470-3e81-4d29-acdc-6438b1b0558d could not be found. Jul 15 20:43:21.806646 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-3bf336d0-a6e1-45b1-8bde-30e64dc9f087 tempest-VolumesSnapshotsTestJSON-1729836074 tempest-VolumesSnapshotsTestJSON-1729836074-project] Request method failure captured: Jul 15 20:43:21.806646 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: request: GET /compute/v2.1/os-snapshots/afebe470-3e81-4d29-acdc-6438b1b0558d HTTP/1.1 Jul 15 20:43:21.806646 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Accept: application/json Jul 15 20:43:21.806646 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Accept-Encoding: identity Jul 15 20:43:21.806646 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Connection: close Jul 15 20:43:21.806646 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Content-Length: 0 Jul 15 20:43:21.806646 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Content-Type: application/json Jul 15 20:43:21.806646 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Host: 10.222.0.66 Jul 15 20:43:21.806646 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Openstack-System-Scope: None Jul 15 20:43:21.806646 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: User-Agent: python-urllib3/1.26.9 Jul 15 20:43:21.806646 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Auth-Token: gAAAAABi0dFjW6U43Z_R4OD1Or-9nqVHqLMOZ-9R63EBiQnzW7l5tQsmqtEeJQ-sOiytav7nlea-7RnCeBzX35bv_aZoCoBO6X93EnrCnOmCuejiX03eQlLohTz43J-hbNLirtySbMv9nZBMh0NLc2yzBj8wm_nMkFycE4YSXDB3SxVEAGEgsaw Jul 15 20:43:21.806646 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Domain-Id: None Jul 15 20:43:21.806646 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Domain-Name: None Jul 15 20:43:21.806646 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Identity-Status: Confirmed Jul 15 20:43:21.806646 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Is-Admin-Project: True Jul 15 20:43:21.806646 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Domain-Id: default Jul 15 20:43:21.806646 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Domain-Name: Default Jul 15 20:43:21.806646 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Id: ff813ccaf61a48fe998c4447dc35c6f3 Jul 15 20:43:21.806646 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1729836074 Jul 15 20:43:21.806646 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Role: member,reader Jul 15 20:43:21.806646 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Roles: member,reader Jul 15 20:43:21.808724 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ff813ccaf61a48fe998c4447dc35c6f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_ff813ccaf61a48fe998c4447dc35c6f3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ff813ccaf61a48fe998c4447dc35c6f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/ff813ccaf61a48fe998c4447dc35c6f3"}]}] Jul 15 20:43:21.808724 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1729836074 Jul 15 20:43:21.808724 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Tenant-Id: ff813ccaf61a48fe998c4447dc35c6f3 Jul 15 20:43:21.808724 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1729836074 Jul 15 20:43:21.808724 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User: tempest-VolumesSnapshotsTestJSON-1729836074-project Jul 15 20:43:21.808724 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Domain-Id: default Jul 15 20:43:21.808724 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Domain-Name: Default Jul 15 20:43:21.808724 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Id: a30b38a10b8c41ac894d4beb9de74510 Jul 15 20:43:21.808724 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1729836074-project Jul 15 20:43:21.808724 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: method: Jul 15 20:43:21.808724 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: exception: Snapshot afebe470-3e81-4d29-acdc-6438b1b0558d could not be found. Jul 15 20:43:21.808724 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: action_args: {'id': 'afebe470-3e81-4d29-acdc-6438b1b0558d'} Jul 15 20:43:21.808724 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 20:43:21.809601 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:43:21.809601 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 15 20:43:21.809601 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 15 20:43:21.809601 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 15 20:43:21.809601 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 15 20:43:21.809601 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 15 20:43:21.809601 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 15 20:43:21.809601 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 15 20:43:21.809601 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 15 20:43:21.809601 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 15 20:43:21.809601 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 15 20:43:21.809601 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 20:43:21.809601 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 20:43:21.809601 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 20:43:21.809601 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 20:43:21.809601 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot afebe470-3e81-4d29-acdc-6438b1b0558d could not be found. (HTTP 404) (Request-ID: req-9f51c1cf-951e-47de-af84-68bd6293c18a) Jul 15 20:43:21.809601 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:43:21.809601 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:43:21.811184 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:43:21.811184 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:43:21.811184 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 15 20:43:21.811184 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 15 20:43:21.811184 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 15 20:43:21.811184 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 15 20:43:21.811184 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 15 20:43:21.811184 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 15 20:43:21.811184 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 15 20:43:21.811184 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 15 20:43:21.811184 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 15 20:43:21.811184 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 15 20:43:21.811184 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 15 20:43:21.811184 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 15 20:43:21.811184 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 15 20:43:21.811184 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 15 20:43:21.811184 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 15 20:43:21.811184 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 15 20:43:21.811184 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 15 20:43:21.812887 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 15 20:43:21.812887 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 20:43:21.812887 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 20:43:21.812887 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 20:43:21.812887 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 20:43:21.812887 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot afebe470-3e81-4d29-acdc-6438b1b0558d could not be found. Jul 15 20:43:21.812887 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:43:21.812887 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:43:21.812887 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:43:21.812887 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:43:21.812887 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:43:21.812887 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:43:21.812887 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 20:43:21.812887 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 20:43:21.812887 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 15 20:43:21.812887 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 15 20:43:21.812887 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 20:43:21.812887 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 20:43:21.812887 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 15 20:43:21.812887 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 20:43:21.814339 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot afebe470-3e81-4d29-acdc-6438b1b0558d could not be found. Jul 15 20:43:21.814339 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:43:21.814339 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:43:21.814339 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:43:21.814339 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:43:21.814339 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:43:21.814339 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:43:21.814339 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 20:43:21.814339 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 20:43:21.814339 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot afebe470-3e81-4d29-acdc-6438b1b0558d could not be found. Jul 15 20:43:21.814339 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:43:21.814339 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-3bf336d0-a6e1-45b1-8bde-30e64dc9f087 tempest-VolumesSnapshotsTestJSON-1729836074 tempest-VolumesSnapshotsTestJSON-1729836074-project] Returning 404 to user: Snapshot afebe470-3e81-4d29-acdc-6438b1b0558d could not be found. {{(pid=124432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 20:43:21.814339 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-3bf336d0-a6e1-45b1-8bde-30e64dc9f087 tempest-VolumesSnapshotsTestJSON-1729836074 tempest-VolumesSnapshotsTestJSON-1729836074-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/afebe470-3e81-4d29-acdc-6438b1b0558d" status: 404 len: 111 microversion: 2.1 time: 0.034444 Jul 15 20:43:21.815301 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 417/831] 10.222.0.66 () {58 vars in 1250 bytes} [Fri Jul 15 20:43:21 2022] GET /compute/v2.1/os-snapshots/afebe470-3e81-4d29-acdc-6438b1b0558d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 20:43:21.817649 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-8145a7ab-2704-417e-8711-3e5eaed561d8 tempest-VolumesSnapshotsTestJSON-1729836074 tempest-VolumesSnapshotsTestJSON-1729836074-project] Calling method '.version_select at 0x7ff518194b80>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:21.879617 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-8145a7ab-2704-417e-8711-3e5eaed561d8 tempest-VolumesSnapshotsTestJSON-1729836074 tempest-VolumesSnapshotsTestJSON-1729836074-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/c6089382-cec3-4a7e-9fc0-7083aea1015d" status: 202 len: 0 microversion: 2.1 time: 0.065616 Jul 15 20:43:21.880180 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 415/832] 10.222.0.66 () {58 vars in 1247 bytes} [Fri Jul 15 20:43:21 2022] DELETE /compute/v2.1/os-volumes/c6089382-cec3-4a7e-9fc0-7083aea1015d => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 20:43:21.889734 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-f118f327-6362-43cd-9f9c-3a152858155e tempest-VolumesSnapshotsTestJSON-1729836074 tempest-VolumesSnapshotsTestJSON-1729836074-project] Calling method '.version_select at 0x7ff518041430>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:21.937900 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-f118f327-6362-43cd-9f9c-3a152858155e tempest-VolumesSnapshotsTestJSON-1729836074 tempest-VolumesSnapshotsTestJSON-1729836074-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/c6089382-cec3-4a7e-9fc0-7083aea1015d" status: 200 len: 345 microversion: 2.1 time: 0.053346 Jul 15 20:43:21.938462 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 418/833] 10.222.0.66 () {58 vars in 1244 bytes} [Fri Jul 15 20:43:21 2022] GET /compute/v2.1/os-volumes/c6089382-cec3-4a7e-9fc0-7083aea1015d => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:43:22.787233 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-efd8c879-8623-4168-8695-aaf6fbacaba5 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:22.787836 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-efd8c879-8623-4168-8695-aaf6fbacaba5 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] [instance: b02f18ea-fd0b-4edd-97a7-17621ab67c8f] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:22.794233 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-efd8c879-8623-4168-8695-aaf6fbacaba5 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:22.794675 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-efd8c879-8623-4168-8695-aaf6fbacaba5 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:22.795437 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-efd8c879-8623-4168-8695-aaf6fbacaba5 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:22.795864 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-efd8c879-8623-4168-8695-aaf6fbacaba5 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:22.928251 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-efd8c879-8623-4168-8695-aaf6fbacaba5 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e27fccbf854a8b8c9d6d099893f783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e1593c67704dbbafad13310ca35448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:22.936291 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-efd8c879-8623-4168-8695-aaf6fbacaba5 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] 10.222.0.66 "GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f" status: 200 len: 1567 microversion: 2.1 time: 0.153356 Jul 15 20:43:22.936886 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 416/834] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:43:22 2022] GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:43:22.951636 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-d0f71043-68b4-42ac-8940-c025f280a979 tempest-VolumesSnapshotsTestJSON-1729836074 tempest-VolumesSnapshotsTestJSON-1729836074-project] Calling method '.version_select at 0x7ff518061940>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:22.978877 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.wsgi [None req-d0f71043-68b4-42ac-8940-c025f280a979 tempest-VolumesSnapshotsTestJSON-1729836074 tempest-VolumesSnapshotsTestJSON-1729836074-project] HTTP exception thrown: Volume c6089382-cec3-4a7e-9fc0-7083aea1015d could not be found. Jul 15 20:43:22.981935 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-d0f71043-68b4-42ac-8940-c025f280a979 tempest-VolumesSnapshotsTestJSON-1729836074 tempest-VolumesSnapshotsTestJSON-1729836074-project] Request method failure captured: Jul 15 20:43:22.981935 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: request: GET /compute/v2.1/os-volumes/c6089382-cec3-4a7e-9fc0-7083aea1015d HTTP/1.1 Jul 15 20:43:22.981935 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Accept: application/json Jul 15 20:43:22.981935 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Accept-Encoding: identity Jul 15 20:43:22.981935 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Connection: close Jul 15 20:43:22.981935 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Content-Length: 0 Jul 15 20:43:22.981935 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Content-Type: application/json Jul 15 20:43:22.981935 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Host: 10.222.0.66 Jul 15 20:43:22.981935 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Openstack-System-Scope: None Jul 15 20:43:22.981935 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: User-Agent: python-urllib3/1.26.9 Jul 15 20:43:22.981935 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Auth-Token: gAAAAABi0dFjW6U43Z_R4OD1Or-9nqVHqLMOZ-9R63EBiQnzW7l5tQsmqtEeJQ-sOiytav7nlea-7RnCeBzX35bv_aZoCoBO6X93EnrCnOmCuejiX03eQlLohTz43J-hbNLirtySbMv9nZBMh0NLc2yzBj8wm_nMkFycE4YSXDB3SxVEAGEgsaw Jul 15 20:43:22.981935 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Domain-Id: None Jul 15 20:43:22.981935 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Domain-Name: None Jul 15 20:43:22.981935 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Identity-Status: Confirmed Jul 15 20:43:22.981935 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Is-Admin-Project: True Jul 15 20:43:22.981935 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Domain-Id: default Jul 15 20:43:22.981935 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Domain-Name: Default Jul 15 20:43:22.981935 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Id: ff813ccaf61a48fe998c4447dc35c6f3 Jul 15 20:43:22.981935 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1729836074 Jul 15 20:43:22.981935 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Role: member,reader Jul 15 20:43:22.981935 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Roles: member,reader Jul 15 20:43:22.983513 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ff813ccaf61a48fe998c4447dc35c6f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_ff813ccaf61a48fe998c4447dc35c6f3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ff813ccaf61a48fe998c4447dc35c6f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/ff813ccaf61a48fe998c4447dc35c6f3"}]}] Jul 15 20:43:22.983513 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1729836074 Jul 15 20:43:22.983513 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Tenant-Id: ff813ccaf61a48fe998c4447dc35c6f3 Jul 15 20:43:22.983513 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1729836074 Jul 15 20:43:22.983513 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User: tempest-VolumesSnapshotsTestJSON-1729836074-project Jul 15 20:43:22.983513 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Domain-Id: default Jul 15 20:43:22.983513 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Domain-Name: Default Jul 15 20:43:22.983513 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Id: a30b38a10b8c41ac894d4beb9de74510 Jul 15 20:43:22.983513 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1729836074-project Jul 15 20:43:22.983513 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: method: Jul 15 20:43:22.983513 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: exception: Volume c6089382-cec3-4a7e-9fc0-7083aea1015d could not be found. Jul 15 20:43:22.983513 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: action_args: {'id': 'c6089382-cec3-4a7e-9fc0-7083aea1015d'} Jul 15 20:43:22.983513 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 20:43:22.984419 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:43:22.984419 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 15 20:43:22.984419 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 15 20:43:22.984419 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 15 20:43:22.984419 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 15 20:43:22.984419 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 15 20:43:22.984419 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 15 20:43:22.984419 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 15 20:43:22.984419 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 15 20:43:22.984419 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 15 20:43:22.984419 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 15 20:43:22.984419 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 20:43:22.984419 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 20:43:22.984419 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 20:43:22.984419 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 20:43:22.984419 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c6089382-cec3-4a7e-9fc0-7083aea1015d could not be found. (HTTP 404) (Request-ID: req-53f9ad0a-46f7-41df-a35b-720976cf3b6e) Jul 15 20:43:22.984419 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:43:22.984419 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:43:22.984419 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:43:22.985873 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:43:22.985873 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 15 20:43:22.985873 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 15 20:43:22.985873 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 15 20:43:22.985873 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 15 20:43:22.985873 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 15 20:43:22.985873 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 15 20:43:22.985873 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 15 20:43:22.985873 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 15 20:43:22.985873 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 15 20:43:22.985873 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 15 20:43:22.985873 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 15 20:43:22.985873 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 15 20:43:22.985873 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 15 20:43:22.985873 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 15 20:43:22.985873 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 15 20:43:22.985873 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 15 20:43:22.985873 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 15 20:43:22.985873 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 15 20:43:22.987281 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 20:43:22.987281 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 20:43:22.987281 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 20:43:22.987281 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 20:43:22.987281 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c6089382-cec3-4a7e-9fc0-7083aea1015d could not be found. Jul 15 20:43:22.987281 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:43:22.987281 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:43:22.987281 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:43:22.987281 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:43:22.987281 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:43:22.987281 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:43:22.987281 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 20:43:22.987281 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 20:43:22.987281 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 15 20:43:22.987281 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 15 20:43:22.987281 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 20:43:22.987281 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 20:43:22.987281 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 15 20:43:22.987281 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 20:43:22.988652 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c6089382-cec3-4a7e-9fc0-7083aea1015d could not be found. Jul 15 20:43:22.988652 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:43:22.988652 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:43:22.988652 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:43:22.988652 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:43:22.988652 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:43:22.988652 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:43:22.988652 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 20:43:22.988652 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 20:43:22.988652 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c6089382-cec3-4a7e-9fc0-7083aea1015d could not be found. Jul 15 20:43:22.988652 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:43:22.988652 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-d0f71043-68b4-42ac-8940-c025f280a979 tempest-VolumesSnapshotsTestJSON-1729836074 tempest-VolumesSnapshotsTestJSON-1729836074-project] Returning 404 to user: Volume c6089382-cec3-4a7e-9fc0-7083aea1015d could not be found. {{(pid=124432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 20:43:22.988652 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-d0f71043-68b4-42ac-8940-c025f280a979 tempest-VolumesSnapshotsTestJSON-1729836074 tempest-VolumesSnapshotsTestJSON-1729836074-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/c6089382-cec3-4a7e-9fc0-7083aea1015d" status: 404 len: 109 microversion: 2.1 time: 0.036720 Jul 15 20:43:22.988652 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 419/835] 10.222.0.66 () {58 vars in 1244 bytes} [Fri Jul 15 20:43:22 2022] GET /compute/v2.1/os-volumes/c6089382-cec3-4a7e-9fc0-7083aea1015d => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 20:43:22.993249 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-5147ba1d-87df-4184-a42b-b1284384acc8 tempest-VolumesSnapshotsTestJSON-1729836074 tempest-VolumesSnapshotsTestJSON-1729836074-project] Calling method '.version_select at 0x7ff5184f4160>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:23.024931 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.wsgi [None req-5147ba1d-87df-4184-a42b-b1284384acc8 tempest-VolumesSnapshotsTestJSON-1729836074 tempest-VolumesSnapshotsTestJSON-1729836074-project] HTTP exception thrown: Volume c6089382-cec3-4a7e-9fc0-7083aea1015d could not be found. Jul 15 20:43:23.026907 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-5147ba1d-87df-4184-a42b-b1284384acc8 tempest-VolumesSnapshotsTestJSON-1729836074 tempest-VolumesSnapshotsTestJSON-1729836074-project] Request method failure captured: Jul 15 20:43:23.026907 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: request: DELETE /compute/v2.1/os-volumes/c6089382-cec3-4a7e-9fc0-7083aea1015d HTTP/1.1 Jul 15 20:43:23.026907 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Accept: application/json Jul 15 20:43:23.026907 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Accept-Encoding: identity Jul 15 20:43:23.026907 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Connection: close Jul 15 20:43:23.026907 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Content-Length: 0 Jul 15 20:43:23.026907 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Content-Type: application/json Jul 15 20:43:23.026907 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Host: 10.222.0.66 Jul 15 20:43:23.026907 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Openstack-System-Scope: None Jul 15 20:43:23.026907 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: User-Agent: python-urllib3/1.26.9 Jul 15 20:43:23.026907 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Auth-Token: gAAAAABi0dFjW6U43Z_R4OD1Or-9nqVHqLMOZ-9R63EBiQnzW7l5tQsmqtEeJQ-sOiytav7nlea-7RnCeBzX35bv_aZoCoBO6X93EnrCnOmCuejiX03eQlLohTz43J-hbNLirtySbMv9nZBMh0NLc2yzBj8wm_nMkFycE4YSXDB3SxVEAGEgsaw Jul 15 20:43:23.026907 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Domain-Id: None Jul 15 20:43:23.026907 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Domain-Name: None Jul 15 20:43:23.026907 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Identity-Status: Confirmed Jul 15 20:43:23.026907 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Is-Admin-Project: True Jul 15 20:43:23.026907 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Domain-Id: default Jul 15 20:43:23.026907 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Domain-Name: Default Jul 15 20:43:23.026907 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Id: ff813ccaf61a48fe998c4447dc35c6f3 Jul 15 20:43:23.026907 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1729836074 Jul 15 20:43:23.026907 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Role: member,reader Jul 15 20:43:23.026907 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Roles: member,reader Jul 15 20:43:23.029312 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ff813ccaf61a48fe998c4447dc35c6f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_ff813ccaf61a48fe998c4447dc35c6f3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ff813ccaf61a48fe998c4447dc35c6f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/ff813ccaf61a48fe998c4447dc35c6f3"}]}] Jul 15 20:43:23.029312 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1729836074 Jul 15 20:43:23.029312 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant-Id: ff813ccaf61a48fe998c4447dc35c6f3 Jul 15 20:43:23.029312 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1729836074 Jul 15 20:43:23.029312 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User: tempest-VolumesSnapshotsTestJSON-1729836074-project Jul 15 20:43:23.029312 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Domain-Id: default Jul 15 20:43:23.029312 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Domain-Name: Default Jul 15 20:43:23.029312 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Id: a30b38a10b8c41ac894d4beb9de74510 Jul 15 20:43:23.029312 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1729836074-project Jul 15 20:43:23.029312 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: method: Jul 15 20:43:23.029312 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: exception: Volume c6089382-cec3-4a7e-9fc0-7083aea1015d could not be found. Jul 15 20:43:23.029312 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: action_args: {'id': 'c6089382-cec3-4a7e-9fc0-7083aea1015d'} Jul 15 20:43:23.029312 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 20:43:23.030733 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:43:23.030733 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 15 20:43:23.030733 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 15 20:43:23.030733 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 15 20:43:23.030733 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 15 20:43:23.030733 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 15 20:43:23.030733 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 15 20:43:23.030733 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 15 20:43:23.030733 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 15 20:43:23.030733 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 15 20:43:23.030733 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 15 20:43:23.030733 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 20:43:23.030733 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 20:43:23.030733 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 20:43:23.030733 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 20:43:23.030733 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c6089382-cec3-4a7e-9fc0-7083aea1015d could not be found. (HTTP 404) (Request-ID: req-4e00c2ef-d5b0-4a3e-a185-d4739b562a71) Jul 15 20:43:23.030733 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:43:23.030733 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:43:23.030733 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:43:23.033098 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:43:23.033098 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 15 20:43:23.033098 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 15 20:43:23.033098 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 15 20:43:23.033098 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 15 20:43:23.033098 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 15 20:43:23.033098 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 15 20:43:23.033098 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 15 20:43:23.033098 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 15 20:43:23.033098 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 15 20:43:23.033098 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 15 20:43:23.033098 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 15 20:43:23.033098 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 15 20:43:23.033098 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 15 20:43:23.033098 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 15 20:43:23.033098 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 15 20:43:23.033098 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 15 20:43:23.033098 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 15 20:43:23.033098 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 15 20:43:23.035567 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 20:43:23.035567 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 20:43:23.035567 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 20:43:23.035567 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 20:43:23.035567 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c6089382-cec3-4a7e-9fc0-7083aea1015d could not be found. Jul 15 20:43:23.035567 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:43:23.035567 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:43:23.035567 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:43:23.035567 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:43:23.035567 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:43:23.035567 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:43:23.035567 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 20:43:23.035567 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 20:43:23.035567 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 15 20:43:23.035567 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 15 20:43:23.035567 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 20:43:23.035567 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 20:43:23.035567 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 15 20:43:23.035567 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 20:43:23.038055 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c6089382-cec3-4a7e-9fc0-7083aea1015d could not be found. Jul 15 20:43:23.038055 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:43:23.038055 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:43:23.038055 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:43:23.038055 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:43:23.038055 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:43:23.038055 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:43:23.038055 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 20:43:23.038055 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 20:43:23.038055 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c6089382-cec3-4a7e-9fc0-7083aea1015d could not be found. Jul 15 20:43:23.038055 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:43:23.038055 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-5147ba1d-87df-4184-a42b-b1284384acc8 tempest-VolumesSnapshotsTestJSON-1729836074 tempest-VolumesSnapshotsTestJSON-1729836074-project] Returning 404 to user: Volume c6089382-cec3-4a7e-9fc0-7083aea1015d could not be found. {{(pid=124430) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 20:43:23.038055 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-5147ba1d-87df-4184-a42b-b1284384acc8 tempest-VolumesSnapshotsTestJSON-1729836074 tempest-VolumesSnapshotsTestJSON-1729836074-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/c6089382-cec3-4a7e-9fc0-7083aea1015d" status: 404 len: 109 microversion: 2.1 time: 0.038809 Jul 15 20:43:23.038055 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 417/836] 10.222.0.66 () {58 vars in 1247 bytes} [Fri Jul 15 20:43:22 2022] DELETE /compute/v2.1/os-volumes/c6089382-cec3-4a7e-9fc0-7083aea1015d => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 20:43:23.040324 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-a2caae34-ec66-426e-8836-8c23bf1267c5 tempest-VolumesSnapshotsTestJSON-1729836074 tempest-VolumesSnapshotsTestJSON-1729836074-project] Calling method '.version_select at 0x7ff518041430>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:23.068499 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.wsgi [None req-a2caae34-ec66-426e-8836-8c23bf1267c5 tempest-VolumesSnapshotsTestJSON-1729836074 tempest-VolumesSnapshotsTestJSON-1729836074-project] HTTP exception thrown: Volume c6089382-cec3-4a7e-9fc0-7083aea1015d could not be found. Jul 15 20:43:23.070495 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-a2caae34-ec66-426e-8836-8c23bf1267c5 tempest-VolumesSnapshotsTestJSON-1729836074 tempest-VolumesSnapshotsTestJSON-1729836074-project] Request method failure captured: Jul 15 20:43:23.070495 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: request: GET /compute/v2.1/os-volumes/c6089382-cec3-4a7e-9fc0-7083aea1015d HTTP/1.1 Jul 15 20:43:23.070495 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Accept: application/json Jul 15 20:43:23.070495 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Accept-Encoding: identity Jul 15 20:43:23.070495 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Connection: close Jul 15 20:43:23.070495 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Content-Length: 0 Jul 15 20:43:23.070495 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Content-Type: application/json Jul 15 20:43:23.070495 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Host: 10.222.0.66 Jul 15 20:43:23.070495 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Openstack-System-Scope: None Jul 15 20:43:23.070495 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: User-Agent: python-urllib3/1.26.9 Jul 15 20:43:23.070495 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Auth-Token: gAAAAABi0dFjW6U43Z_R4OD1Or-9nqVHqLMOZ-9R63EBiQnzW7l5tQsmqtEeJQ-sOiytav7nlea-7RnCeBzX35bv_aZoCoBO6X93EnrCnOmCuejiX03eQlLohTz43J-hbNLirtySbMv9nZBMh0NLc2yzBj8wm_nMkFycE4YSXDB3SxVEAGEgsaw Jul 15 20:43:23.070495 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Domain-Id: None Jul 15 20:43:23.070495 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Domain-Name: None Jul 15 20:43:23.070495 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Identity-Status: Confirmed Jul 15 20:43:23.070495 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Is-Admin-Project: True Jul 15 20:43:23.070495 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Domain-Id: default Jul 15 20:43:23.070495 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Domain-Name: Default Jul 15 20:43:23.070495 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Id: ff813ccaf61a48fe998c4447dc35c6f3 Jul 15 20:43:23.070495 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1729836074 Jul 15 20:43:23.070495 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Role: member,reader Jul 15 20:43:23.070495 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Roles: member,reader Jul 15 20:43:23.072067 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ff813ccaf61a48fe998c4447dc35c6f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_ff813ccaf61a48fe998c4447dc35c6f3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ff813ccaf61a48fe998c4447dc35c6f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/ff813ccaf61a48fe998c4447dc35c6f3"}]}] Jul 15 20:43:23.072067 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1729836074 Jul 15 20:43:23.072067 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Tenant-Id: ff813ccaf61a48fe998c4447dc35c6f3 Jul 15 20:43:23.072067 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1729836074 Jul 15 20:43:23.072067 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User: tempest-VolumesSnapshotsTestJSON-1729836074-project Jul 15 20:43:23.072067 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Domain-Id: default Jul 15 20:43:23.072067 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Domain-Name: Default Jul 15 20:43:23.072067 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Id: a30b38a10b8c41ac894d4beb9de74510 Jul 15 20:43:23.072067 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1729836074-project Jul 15 20:43:23.072067 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: method: Jul 15 20:43:23.072067 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: exception: Volume c6089382-cec3-4a7e-9fc0-7083aea1015d could not be found. Jul 15 20:43:23.072067 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: action_args: {'id': 'c6089382-cec3-4a7e-9fc0-7083aea1015d'} Jul 15 20:43:23.072067 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 20:43:23.073080 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:43:23.073080 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 15 20:43:23.073080 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 15 20:43:23.073080 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 15 20:43:23.073080 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 15 20:43:23.073080 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 15 20:43:23.073080 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 15 20:43:23.073080 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 15 20:43:23.073080 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 15 20:43:23.073080 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 15 20:43:23.073080 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 15 20:43:23.073080 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 20:43:23.073080 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 20:43:23.073080 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 20:43:23.073080 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 20:43:23.073080 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c6089382-cec3-4a7e-9fc0-7083aea1015d could not be found. (HTTP 404) (Request-ID: req-652734dd-1e3e-42ab-bed2-9bf1a5973ccd) Jul 15 20:43:23.073080 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:43:23.073080 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:43:23.073080 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:43:23.074561 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:43:23.074561 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 15 20:43:23.074561 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 15 20:43:23.074561 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 15 20:43:23.074561 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 15 20:43:23.074561 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 15 20:43:23.074561 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 15 20:43:23.074561 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 15 20:43:23.074561 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 15 20:43:23.074561 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 15 20:43:23.074561 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 15 20:43:23.074561 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 15 20:43:23.074561 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 15 20:43:23.074561 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 15 20:43:23.074561 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 15 20:43:23.074561 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 15 20:43:23.074561 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 15 20:43:23.074561 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 15 20:43:23.074561 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 15 20:43:23.075905 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 20:43:23.075905 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 20:43:23.075905 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 20:43:23.075905 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 20:43:23.075905 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c6089382-cec3-4a7e-9fc0-7083aea1015d could not be found. Jul 15 20:43:23.075905 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:43:23.075905 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:43:23.075905 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:43:23.075905 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:43:23.075905 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:43:23.075905 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:43:23.075905 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 20:43:23.075905 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 20:43:23.075905 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 15 20:43:23.075905 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 15 20:43:23.075905 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 20:43:23.075905 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 20:43:23.075905 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 15 20:43:23.075905 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 20:43:23.077279 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c6089382-cec3-4a7e-9fc0-7083aea1015d could not be found. Jul 15 20:43:23.077279 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:43:23.077279 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:43:23.077279 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:43:23.077279 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:43:23.077279 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:43:23.077279 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:43:23.077279 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 20:43:23.077279 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 20:43:23.077279 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c6089382-cec3-4a7e-9fc0-7083aea1015d could not be found. Jul 15 20:43:23.077279 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:43:23.077279 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-a2caae34-ec66-426e-8836-8c23bf1267c5 tempest-VolumesSnapshotsTestJSON-1729836074 tempest-VolumesSnapshotsTestJSON-1729836074-project] Returning 404 to user: Volume c6089382-cec3-4a7e-9fc0-7083aea1015d could not be found. {{(pid=124432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 20:43:23.077279 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-a2caae34-ec66-426e-8836-8c23bf1267c5 tempest-VolumesSnapshotsTestJSON-1729836074 tempest-VolumesSnapshotsTestJSON-1729836074-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/c6089382-cec3-4a7e-9fc0-7083aea1015d" status: 404 len: 109 microversion: 2.1 time: 0.038554 Jul 15 20:43:23.077279 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 420/837] 10.222.0.66 () {58 vars in 1244 bytes} [Fri Jul 15 20:43:23 2022] GET /compute/v2.1/os-volumes/c6089382-cec3-4a7e-9fc0-7083aea1015d => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 20:43:23.954042 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-39233ccd-72b7-4c24-b72f-9dfd9b2b2551 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:23.954640 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-39233ccd-72b7-4c24-b72f-9dfd9b2b2551 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] [instance: b02f18ea-fd0b-4edd-97a7-17621ab67c8f] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:23.961678 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-39233ccd-72b7-4c24-b72f-9dfd9b2b2551 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:23.962172 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-39233ccd-72b7-4c24-b72f-9dfd9b2b2551 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:23.962918 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-39233ccd-72b7-4c24-b72f-9dfd9b2b2551 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:23.963390 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-39233ccd-72b7-4c24-b72f-9dfd9b2b2551 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:24.100626 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-39233ccd-72b7-4c24-b72f-9dfd9b2b2551 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e27fccbf854a8b8c9d6d099893f783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e1593c67704dbbafad13310ca35448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:24.108916 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-39233ccd-72b7-4c24-b72f-9dfd9b2b2551 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] 10.222.0.66 "GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f" status: 200 len: 1508 microversion: 2.1 time: 0.159402 Jul 15 20:43:24.110153 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 418/838] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:43:23 2022] GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:43:24.126832 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-8e8d9475-2089-45eb-a53f-68efbe0dd452 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:43:24.127395 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-8e8d9475-2089-45eb-a53f-68efbe0dd452 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] [instance: b02f18ea-fd0b-4edd-97a7-17621ab67c8f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:24.133643 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8e8d9475-2089-45eb-a53f-68efbe0dd452 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:24.134088 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8e8d9475-2089-45eb-a53f-68efbe0dd452 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:24.134853 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8e8d9475-2089-45eb-a53f-68efbe0dd452 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:24.135284 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8e8d9475-2089-45eb-a53f-68efbe0dd452 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:24.227173 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-8e8d9475-2089-45eb-a53f-68efbe0dd452 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] 10.222.0.66 "POST /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f/action" status: 202 len: 0 microversion: 2.1 time: 0.105094 Jul 15 20:43:24.227768 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 421/839] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 15 20:43:24 2022] POST /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 15 20:43:24.242575 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-f0510705-6fe8-4110-8cfd-56c8d0279982 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:24.243175 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-f0510705-6fe8-4110-8cfd-56c8d0279982 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] [instance: b02f18ea-fd0b-4edd-97a7-17621ab67c8f] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:24.259827 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-f0510705-6fe8-4110-8cfd-56c8d0279982 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:24.260270 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-f0510705-6fe8-4110-8cfd-56c8d0279982 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:24.261120 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-f0510705-6fe8-4110-8cfd-56c8d0279982 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:24.261739 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-f0510705-6fe8-4110-8cfd-56c8d0279982 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:24.422683 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-f0510705-6fe8-4110-8cfd-56c8d0279982 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e27fccbf854a8b8c9d6d099893f783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e1593c67704dbbafad13310ca35448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:24.430816 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-f0510705-6fe8-4110-8cfd-56c8d0279982 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] 10.222.0.66 "GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f" status: 200 len: 1516 microversion: 2.1 time: 0.191508 Jul 15 20:43:24.431550 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 419/840] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:43:24 2022] GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f => generated 1516 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:43:25.451808 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-3d3eaea3-743b-48c3-b45c-cc7257b7399e tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:25.452896 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-3d3eaea3-743b-48c3-b45c-cc7257b7399e tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] [instance: b02f18ea-fd0b-4edd-97a7-17621ab67c8f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:25.461256 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3d3eaea3-743b-48c3-b45c-cc7257b7399e tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:25.461710 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3d3eaea3-743b-48c3-b45c-cc7257b7399e tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:25.462479 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3d3eaea3-743b-48c3-b45c-cc7257b7399e tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:25.462917 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3d3eaea3-743b-48c3-b45c-cc7257b7399e tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:25.602733 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-3d3eaea3-743b-48c3-b45c-cc7257b7399e tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e27fccbf854a8b8c9d6d099893f783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e1593c67704dbbafad13310ca35448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:25.610753 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-3d3eaea3-743b-48c3-b45c-cc7257b7399e tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] 10.222.0.66 "GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f" status: 200 len: 1518 microversion: 2.1 time: 0.164023 Jul 15 20:43:25.611314 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 422/841] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:43:25 2022] GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f => generated 1518 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:43:25.976045 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-27cb1211-5b90-4a4e-ac20-a2532493757b tempest-VolumesTestJSON-1337936047 tempest-VolumesTestJSON-1337936047-project] Calling method '.version_select at 0x7ff5182121f0>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:26.023086 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-27cb1211-5b90-4a4e-ac20-a2532493757b tempest-VolumesTestJSON-1337936047 tempest-VolumesTestJSON-1337936047-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/a4dfa8d9-025a-49a7-8b4b-86de41ab0556" status: 200 len: 351 microversion: 2.1 time: 0.050756 Jul 15 20:43:26.023651 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 420/842] 10.222.0.66 () {58 vars in 1244 bytes} [Fri Jul 15 20:43:25 2022] GET /compute/v2.1/os-volumes/a4dfa8d9-025a-49a7-8b4b-86de41ab0556 => generated 351 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:43:26.434691 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-9cd5866a-731a-49f4-9415-fa54db02bec9 req-3d102292-6c9b-4562-b85c-d772d72231d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b02f18ea-fd0b-4edd-97a7-17621ab67c8f", "name": "network-vif-unplugged", "status": "completed", "tag": "dc16e8e1-450a-4c4e-9a65-56300299d066"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:43:26.452778 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-9cd5866a-731a-49f4-9415-fa54db02bec9 req-3d102292-6c9b-4562-b85c-d772d72231d6 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:26.453898 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-9cd5866a-731a-49f4-9415-fa54db02bec9 req-3d102292-6c9b-4562-b85c-d772d72231d6 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:26.472874 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-9cd5866a-731a-49f4-9415-fa54db02bec9 req-3d102292-6c9b-4562-b85c-d772d72231d6 service nova] Creating event network-vif-unplugged:dc16e8e1-450a-4c4e-9a65-56300299d066 for instance b02f18ea-fd0b-4edd-97a7-17621ab67c8f on hv-cinder-79987 Jul 15 20:43:26.478997 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-9cd5866a-731a-49f4-9415-fa54db02bec9 req-3d102292-6c9b-4562-b85c-d772d72231d6 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052089 Jul 15 20:43:26.480909 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 423/843] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:43:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:43:26.628200 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-d4271588-164b-489d-a446-39adee08277b tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:26.628838 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-d4271588-164b-489d-a446-39adee08277b tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] [instance: b02f18ea-fd0b-4edd-97a7-17621ab67c8f] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:26.634756 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d4271588-164b-489d-a446-39adee08277b tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:26.635261 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d4271588-164b-489d-a446-39adee08277b tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:26.636066 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d4271588-164b-489d-a446-39adee08277b tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:26.636525 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d4271588-164b-489d-a446-39adee08277b tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:26.775808 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-d4271588-164b-489d-a446-39adee08277b tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e27fccbf854a8b8c9d6d099893f783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e1593c67704dbbafad13310ca35448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:26.784431 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-d4271588-164b-489d-a446-39adee08277b tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] 10.222.0.66 "GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f" status: 200 len: 1574 microversion: 2.1 time: 0.160015 Jul 15 20:43:26.784996 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 421/844] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:43:26 2022] GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:43:27.359510 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-b75c4788-0118-4945-ab06-17520e4d7fa5 tempest-VolumesTestJSON-1337936047 tempest-VolumesTestJSON-1337936047-project] Calling method '.version_select at 0x7ff5137e4f70>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:27.405467 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-b75c4788-0118-4945-ab06-17520e4d7fa5 tempest-VolumesTestJSON-1337936047 tempest-VolumesTestJSON-1337936047-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/479f5933-8656-433f-bee3-3922ebf8d109" status: 200 len: 350 microversion: 2.1 time: 0.050016 Jul 15 20:43:27.406019 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 424/845] 10.222.0.66 () {58 vars in 1244 bytes} [Fri Jul 15 20:43:27 2022] GET /compute/v2.1/os-volumes/479f5933-8656-433f-bee3-3922ebf8d109 => generated 350 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:43:27.803015 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-917d332a-733c-4a4c-a036-e19198be3a71 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:27.803626 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-917d332a-733c-4a4c-a036-e19198be3a71 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] [instance: b02f18ea-fd0b-4edd-97a7-17621ab67c8f] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:27.811170 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-917d332a-733c-4a4c-a036-e19198be3a71 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:27.811620 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-917d332a-733c-4a4c-a036-e19198be3a71 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:27.812380 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-917d332a-733c-4a4c-a036-e19198be3a71 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:27.812843 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-917d332a-733c-4a4c-a036-e19198be3a71 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:27.943412 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-917d332a-733c-4a4c-a036-e19198be3a71 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e27fccbf854a8b8c9d6d099893f783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e1593c67704dbbafad13310ca35448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:27.951518 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-917d332a-733c-4a4c-a036-e19198be3a71 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] 10.222.0.66 "GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f" status: 200 len: 1574 microversion: 2.1 time: 0.152333 Jul 15 20:43:27.952072 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 422/846] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:43:27 2022] GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:43:28.731185 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-5eb6c1e9-a92e-4da4-8a58-a584873498dc tempest-VolumesTestJSON-1337936047 tempest-VolumesTestJSON-1337936047-project] Calling method '.version_select at 0x7ff5137d6700>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:28.776420 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-5eb6c1e9-a92e-4da4-8a58-a584873498dc tempest-VolumesTestJSON-1337936047 tempest-VolumesTestJSON-1337936047-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/829f16f4-d340-4899-8f84-e8c42eb2085a" status: 200 len: 351 microversion: 2.1 time: 0.049471 Jul 15 20:43:28.777075 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 425/847] 10.222.0.66 () {58 vars in 1244 bytes} [Fri Jul 15 20:43:28 2022] GET /compute/v2.1/os-volumes/829f16f4-d340-4899-8f84-e8c42eb2085a => generated 351 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:43:28.787926 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-230fe645-6029-496c-96bd-f330c69b27d1 tempest-VolumesTestJSON-1337936047 tempest-VolumesTestJSON-1337936047-project] Calling method '.version_select at 0x7ff5181cc1f0>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:28.871230 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-230fe645-6029-496c-96bd-f330c69b27d1 tempest-VolumesTestJSON-1337936047 tempest-VolumesTestJSON-1337936047-project] 10.222.0.66 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.086924 Jul 15 20:43:28.871876 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 423/848] 10.222.0.66 () {58 vars in 1133 bytes} [Fri Jul 15 20:43:28 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:43:28.883751 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-dfe83545-e85e-40bd-9af3-867af62c0d06 tempest-VolumesTestJSON-1337936047 tempest-VolumesTestJSON-1337936047-project] Calling method '.version_select at 0x7ff5137d60d0>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:28.964562 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-dfe83545-e85e-40bd-9af3-867af62c0d06 tempest-VolumesTestJSON-1337936047 tempest-VolumesTestJSON-1337936047-project] 10.222.0.66 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.083667 Jul 15 20:43:28.965130 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 426/849] 10.222.0.66 () {58 vars in 1148 bytes} [Fri Jul 15 20:43:28 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:43:28.969328 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-41060db1-a07d-469d-9dd6-89540f330d10 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:28.969943 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-41060db1-a07d-469d-9dd6-89540f330d10 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] [instance: b02f18ea-fd0b-4edd-97a7-17621ab67c8f] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:28.976133 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-41060db1-a07d-469d-9dd6-89540f330d10 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:28.976283 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-29792d18-fd36-4dba-ba8a-6c352e8cef22 tempest-VolumesTestJSON-1337936047 tempest-VolumesTestJSON-1337936047-project] Calling method '.version_select at 0x7ff518061ca0>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:28.976622 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-41060db1-a07d-469d-9dd6-89540f330d10 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:28.977388 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-41060db1-a07d-469d-9dd6-89540f330d10 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:28.977824 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-41060db1-a07d-469d-9dd6-89540f330d10 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:29.056215 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-29792d18-fd36-4dba-ba8a-6c352e8cef22 tempest-VolumesTestJSON-1337936047 tempest-VolumesTestJSON-1337936047-project] 10.222.0.66 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.083370 Jul 15 20:43:29.056817 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 427/850] 10.222.0.66 () {58 vars in 1133 bytes} [Fri Jul 15 20:43:28 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:43:29.067716 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-17bf6e28-9737-4a71-8c3c-dd65f6550f51 tempest-VolumesTestJSON-1337936047 tempest-VolumesTestJSON-1337936047-project] Calling method '.version_select at 0x7ff5137d6ca0>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:29.118463 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-41060db1-a07d-469d-9dd6-89540f330d10 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e27fccbf854a8b8c9d6d099893f783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e1593c67704dbbafad13310ca35448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:29.125873 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-41060db1-a07d-469d-9dd6-89540f330d10 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] 10.222.0.66 "GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f" status: 200 len: 1574 microversion: 2.1 time: 0.160206 Jul 15 20:43:29.126430 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 424/851] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:43:28 2022] GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f => generated 1574 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:43:29.149031 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-17bf6e28-9737-4a71-8c3c-dd65f6550f51 tempest-VolumesTestJSON-1337936047 tempest-VolumesTestJSON-1337936047-project] 10.222.0.66 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.084896 Jul 15 20:43:29.149592 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 428/852] 10.222.0.66 () {58 vars in 1166 bytes} [Fri Jul 15 20:43:29 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 20:43:29.161690 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-c05cbc30-1b91-44f8-b60a-704d1b49bd94 tempest-VolumesTestJSON-1337936047 tempest-VolumesTestJSON-1337936047-project] Calling method '.version_select at 0x7ff5181ccee0>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:29.241093 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-c05cbc30-1b91-44f8-b60a-704d1b49bd94 tempest-VolumesTestJSON-1337936047 tempest-VolumesTestJSON-1337936047-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.082988 Jul 15 20:43:29.241649 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 425/853] 10.222.0.66 () {58 vars in 1169 bytes} [Fri Jul 15 20:43:29 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:43:29.253639 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-5f171a3b-edea-4e6d-a34f-8e3aeb1c4913 tempest-VolumesTestJSON-1337936047 tempest-VolumesTestJSON-1337936047-project] Calling method '.version_select at 0x7ff5137e41f0>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:29.333439 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-5f171a3b-edea-4e6d-a34f-8e3aeb1c4913 tempest-VolumesTestJSON-1337936047 tempest-VolumesTestJSON-1337936047-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.083395 Jul 15 20:43:29.333998 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 429/854] 10.222.0.66 () {58 vars in 1154 bytes} [Fri Jul 15 20:43:29 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:43:29.345643 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-6961f3fd-0bb9-41a0-a2b4-953807836539 tempest-VolumesTestJSON-1337936047 tempest-VolumesTestJSON-1337936047-project] Calling method '.version_select at 0x7ff518271dc0>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:29.427663 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-6961f3fd-0bb9-41a0-a2b4-953807836539 tempest-VolumesTestJSON-1337936047 tempest-VolumesTestJSON-1337936047-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.085653 Jul 15 20:43:29.428232 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 426/855] 10.222.0.66 () {58 vars in 1187 bytes} [Fri Jul 15 20:43:29 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:43:29.439885 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-02b3ae92-2f4d-437e-89ac-8d422520070c tempest-VolumesTestJSON-1337936047 tempest-VolumesTestJSON-1337936047-project] Calling method '.version_select at 0x7ff518041670>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:29.519571 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-02b3ae92-2f4d-437e-89ac-8d422520070c tempest-VolumesTestJSON-1337936047 tempest-VolumesTestJSON-1337936047-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.083278 Jul 15 20:43:29.520131 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 430/856] 10.222.0.66 () {58 vars in 1154 bytes} [Fri Jul 15 20:43:29 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:43:30.143514 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-03d491aa-69da-4dd5-ac25-a923a0cf895a tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:30.144036 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-03d491aa-69da-4dd5-ac25-a923a0cf895a tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] [instance: b02f18ea-fd0b-4edd-97a7-17621ab67c8f] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:30.150587 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-03d491aa-69da-4dd5-ac25-a923a0cf895a tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:30.151546 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-03d491aa-69da-4dd5-ac25-a923a0cf895a tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:30.152491 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-03d491aa-69da-4dd5-ac25-a923a0cf895a tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:30.152920 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-03d491aa-69da-4dd5-ac25-a923a0cf895a tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:30.283873 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-03d491aa-69da-4dd5-ac25-a923a0cf895a tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e27fccbf854a8b8c9d6d099893f783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e1593c67704dbbafad13310ca35448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:30.291595 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-03d491aa-69da-4dd5-ac25-a923a0cf895a tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] 10.222.0.66 "GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f" status: 200 len: 1574 microversion: 2.1 time: 0.152456 Jul 15 20:43:30.292121 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 427/857] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:43:30 2022] GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:43:31.309593 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-5f957e2d-45c8-4d92-b022-ef36389be217 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:31.310233 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-5f957e2d-45c8-4d92-b022-ef36389be217 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] [instance: b02f18ea-fd0b-4edd-97a7-17621ab67c8f] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:31.316800 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-5f957e2d-45c8-4d92-b022-ef36389be217 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:31.317247 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-5f957e2d-45c8-4d92-b022-ef36389be217 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:31.318010 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-5f957e2d-45c8-4d92-b022-ef36389be217 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:31.318443 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-5f957e2d-45c8-4d92-b022-ef36389be217 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:31.385400 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-22180453-2798-4f0d-99ed-3df497dae9c3 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:31.386254 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-22180453-2798-4f0d-99ed-3df497dae9c3 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 0b11cb14-b513-4341-a418-ddf26c9e464e] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:31.392946 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-22180453-2798-4f0d-99ed-3df497dae9c3 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:31.393392 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-22180453-2798-4f0d-99ed-3df497dae9c3 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:31.394160 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-22180453-2798-4f0d-99ed-3df497dae9c3 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:31.394593 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-22180453-2798-4f0d-99ed-3df497dae9c3 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:31.417886 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-22180453-2798-4f0d-99ed-3df497dae9c3 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/0b11cb14-b513-4341-a418-ddf26c9e464e/ips" status: 200 len: 145 microversion: 2.1 time: 0.143985 Jul 15 20:43:31.418439 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 431/858] 10.222.0.66 () {58 vars in 1247 bytes} [Fri Jul 15 20:43:31 2022] GET /compute/v2.1/servers/0b11cb14-b513-4341-a418-ddf26c9e464e/ips => generated 145 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:43:31.455924 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-5f957e2d-45c8-4d92-b022-ef36389be217 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e27fccbf854a8b8c9d6d099893f783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e1593c67704dbbafad13310ca35448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:31.469071 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-5f957e2d-45c8-4d92-b022-ef36389be217 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] 10.222.0.66 "GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f" status: 200 len: 1574 microversion: 2.1 time: 0.163957 Jul 15 20:43:31.469835 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 428/859] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:43:31 2022] GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f => generated 1574 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:43:32.486288 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-11dffa3f-f990-4fe3-b3f8-231627e00a5b tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:32.486892 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-11dffa3f-f990-4fe3-b3f8-231627e00a5b tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] [instance: b02f18ea-fd0b-4edd-97a7-17621ab67c8f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:32.493426 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-11dffa3f-f990-4fe3-b3f8-231627e00a5b tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:32.493894 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-11dffa3f-f990-4fe3-b3f8-231627e00a5b tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:32.495123 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-11dffa3f-f990-4fe3-b3f8-231627e00a5b tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:32.495555 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-11dffa3f-f990-4fe3-b3f8-231627e00a5b tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:32.628754 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-11dffa3f-f990-4fe3-b3f8-231627e00a5b tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e27fccbf854a8b8c9d6d099893f783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e1593c67704dbbafad13310ca35448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:32.637054 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-11dffa3f-f990-4fe3-b3f8-231627e00a5b tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] 10.222.0.66 "GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f" status: 200 len: 1574 microversion: 2.1 time: 0.154488 Jul 15 20:43:32.637644 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 432/860] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:43:32 2022] GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:43:32.739878 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-d87053cc-ae7e-4222-b8a6-d7076ab937a8 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "41419fef-b337-4c95-b756-25f1f2dd3727"}} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:43:32.741220 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-d87053cc-ae7e-4222-b8a6-d7076ab937a8 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 0b11cb14-b513-4341-a418-ddf26c9e464e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:32.749250 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d87053cc-ae7e-4222-b8a6-d7076ab937a8 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:32.749700 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d87053cc-ae7e-4222-b8a6-d7076ab937a8 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:32.750457 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d87053cc-ae7e-4222-b8a6-d7076ab937a8 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:32.750886 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d87053cc-ae7e-4222-b8a6-d7076ab937a8 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:33.001664 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-d87053cc-ae7e-4222-b8a6-d7076ab937a8 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "POST /compute/v2.1/servers/0b11cb14-b513-4341-a418-ddf26c9e464e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.266593 Jul 15 20:43:33.002419 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 429/861] 10.222.0.66 () {60 vars in 1322 bytes} [Fri Jul 15 20:43:32 2022] POST /compute/v2.1/servers/0b11cb14-b513-4341-a418-ddf26c9e464e/os-volume_attachments => generated 194 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 20:43:33.653699 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-5e439f0a-ee82-4798-b6c2-39e3a39d3748 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:33.654414 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-5e439f0a-ee82-4798-b6c2-39e3a39d3748 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] [instance: b02f18ea-fd0b-4edd-97a7-17621ab67c8f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:33.662006 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5e439f0a-ee82-4798-b6c2-39e3a39d3748 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:33.662459 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5e439f0a-ee82-4798-b6c2-39e3a39d3748 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:33.663229 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5e439f0a-ee82-4798-b6c2-39e3a39d3748 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:33.663663 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5e439f0a-ee82-4798-b6c2-39e3a39d3748 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:33.668913 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:43:33.805697 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-5e439f0a-ee82-4798-b6c2-39e3a39d3748 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e27fccbf854a8b8c9d6d099893f783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e1593c67704dbbafad13310ca35448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:33.813986 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-5e439f0a-ee82-4798-b6c2-39e3a39d3748 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] 10.222.0.66 "GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f" status: 200 len: 1574 microversion: 2.1 time: 0.164833 Jul 15 20:43:33.814550 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 433/862] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:43:33 2022] GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f => generated 1574 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:43:34.832317 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-c6545e44-65a8-4bd9-869e-2bfd320fa340 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:34.833260 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-c6545e44-65a8-4bd9-869e-2bfd320fa340 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] [instance: b02f18ea-fd0b-4edd-97a7-17621ab67c8f] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:34.840885 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c6545e44-65a8-4bd9-869e-2bfd320fa340 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:34.841331 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c6545e44-65a8-4bd9-869e-2bfd320fa340 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:34.842107 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c6545e44-65a8-4bd9-869e-2bfd320fa340 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:34.842543 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c6545e44-65a8-4bd9-869e-2bfd320fa340 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:34.998709 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-c6545e44-65a8-4bd9-869e-2bfd320fa340 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e27fccbf854a8b8c9d6d099893f783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e1593c67704dbbafad13310ca35448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:35.007399 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-c6545e44-65a8-4bd9-869e-2bfd320fa340 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] 10.222.0.66 "GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f" status: 200 len: 1561 microversion: 2.1 time: 0.180061 Jul 15 20:43:35.008667 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 430/863] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:43:34 2022] GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f => generated 1561 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:43:36.522419 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-4c5153cc-620b-45a5-b923-2a0ba72e412f req-e60def95-095f-40a2-b587-ad5124031ffe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b02f18ea-fd0b-4edd-97a7-17621ab67c8f", "name": "network-vif-plugged", "status": "completed", "tag": "dc16e8e1-450a-4c4e-9a65-56300299d066"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:43:36.533690 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-4c5153cc-620b-45a5-b923-2a0ba72e412f req-e60def95-095f-40a2-b587-ad5124031ffe service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:36.534552 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-4c5153cc-620b-45a5-b923-2a0ba72e412f req-e60def95-095f-40a2-b587-ad5124031ffe service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:36.547315 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-4c5153cc-620b-45a5-b923-2a0ba72e412f req-e60def95-095f-40a2-b587-ad5124031ffe service nova] Creating event network-vif-plugged:dc16e8e1-450a-4c4e-9a65-56300299d066 for instance b02f18ea-fd0b-4edd-97a7-17621ab67c8f on hv-cinder-79987 Jul 15 20:43:36.553964 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-4c5153cc-620b-45a5-b923-2a0ba72e412f req-e60def95-095f-40a2-b587-ad5124031ffe service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035813 Jul 15 20:43:36.554784 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 434/864] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:43:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:43:37.953177 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-1670f5a9-3a8e-4e31-bc38-5f03a4abb97e tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:37.953177 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-1670f5a9-3a8e-4e31-bc38-5f03a4abb97e tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 526626a0-8b46-4f4a-9371-4b310ac67640] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:37.954920 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-1670f5a9-3a8e-4e31-bc38-5f03a4abb97e tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:37.955438 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-1670f5a9-3a8e-4e31-bc38-5f03a4abb97e tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:37.956282 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-1670f5a9-3a8e-4e31-bc38-5f03a4abb97e tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:37.956750 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-1670f5a9-3a8e-4e31-bc38-5f03a4abb97e tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:37.980792 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-1670f5a9-3a8e-4e31-bc38-5f03a4abb97e tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640/ips" status: 200 len: 152 microversion: 2.20 time: 0.038573 Jul 15 20:43:37.981364 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 431/865] 10.222.0.66 () {60 vars in 1288 bytes} [Fri Jul 15 20:43:37 2022] GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640/ips => generated 152 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 20:43:40.511564 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-910d75f4-d111-4df7-963a-3445d982e061 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:40.513400 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-910d75f4-d111-4df7-963a-3445d982e061 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 0b11cb14-b513-4341-a418-ddf26c9e464e] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:40.515758 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_api:SELECT=32 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:43:40.521333 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-910d75f4-d111-4df7-963a-3445d982e061 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:40.521773 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-910d75f4-d111-4df7-963a-3445d982e061 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:40.522531 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-910d75f4-d111-4df7-963a-3445d982e061 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:40.522985 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-910d75f4-d111-4df7-963a-3445d982e061 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:40.551562 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-6945aa96-11e1-40bb-8243-bb2d9c12c4a0 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:43:40.552225 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-6945aa96-11e1-40bb-8243-bb2d9c12c4a0 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 526626a0-8b46-4f4a-9371-4b310ac67640] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:40.553108 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-910d75f4-d111-4df7-963a-3445d982e061 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/0b11cb14-b513-4341-a418-ddf26c9e464e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047350 Jul 15 20:43:40.553876 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 435/866] 10.222.0.66 () {58 vars in 1301 bytes} [Fri Jul 15 20:43:40 2022] GET /compute/v2.1/servers/0b11cb14-b513-4341-a418-ddf26c9e464e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:43:40.558995 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-6945aa96-11e1-40bb-8243-bb2d9c12c4a0 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:40.559560 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-6945aa96-11e1-40bb-8243-bb2d9c12c4a0 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:40.560502 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-6945aa96-11e1-40bb-8243-bb2d9c12c4a0 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:40.561136 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-6945aa96-11e1-40bb-8243-bb2d9c12c4a0 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:40.563471 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-720d772e-0752-40fb-849d-db35dc1e380e tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:40.563768 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-720d772e-0752-40fb-849d-db35dc1e380e tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 0b11cb14-b513-4341-a418-ddf26c9e464e] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:40.570824 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-720d772e-0752-40fb-849d-db35dc1e380e tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:40.571513 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-720d772e-0752-40fb-849d-db35dc1e380e tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:40.573031 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-720d772e-0752-40fb-849d-db35dc1e380e tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:40.573492 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-720d772e-0752-40fb-849d-db35dc1e380e tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:40.585974 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.objects.instance [None req-6945aa96-11e1-40bb-8243-bb2d9c12c4a0 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lazy-loading 'flavor' on Instance uuid 526626a0-8b46-4f4a-9371-4b310ac67640 {{(pid=124430) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 20:43:40.607168 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-720d772e-0752-40fb-849d-db35dc1e380e tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/0b11cb14-b513-4341-a418-ddf26c9e464e/os-volume_attachments/41419fef-b337-4c95-b756-25f1f2dd3727" status: 200 len: 194 microversion: 2.1 time: 0.047553 Jul 15 20:43:40.607975 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 436/867] 10.222.0.66 () {58 vars in 1412 bytes} [Fri Jul 15 20:43:40 2022] GET /compute/v2.1/servers/0b11cb14-b513-4341-a418-ddf26c9e464e/os-volume_attachments/41419fef-b337-4c95-b756-25f1f2dd3727 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 20:43:40.887778 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-6945aa96-11e1-40bb-8243-bb2d9c12c4a0 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "POST /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640/action" status: 202 len: 0 microversion: 2.20 time: 0.339947 Jul 15 20:43:40.889327 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 432/868] 10.222.0.66 () {62 vars in 1318 bytes} [Fri Jul 15 20:43:40 2022] POST /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640/action => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 15 20:43:40.898905 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-4be6d3d0-faa2-468d-8d87-8df5403456cd tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:40.899679 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-4be6d3d0-faa2-468d-8d87-8df5403456cd tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 526626a0-8b46-4f4a-9371-4b310ac67640] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:40.908985 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4be6d3d0-faa2-468d-8d87-8df5403456cd tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:40.910506 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4be6d3d0-faa2-468d-8d87-8df5403456cd tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:40.912080 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4be6d3d0-faa2-468d-8d87-8df5403456cd tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:40.912648 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4be6d3d0-faa2-468d-8d87-8df5403456cd tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:41.058392 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-4be6d3d0-faa2-468d-8d87-8df5403456cd tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:41.066368 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-4be6d3d0-faa2-468d-8d87-8df5403456cd tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:41.067804 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-4be6d3d0-faa2-468d-8d87-8df5403456cd tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:41.068999 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-4be6d3d0-faa2-468d-8d87-8df5403456cd tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640" status: 200 len: 1723 microversion: 2.20 time: 0.176373 Jul 15 20:43:41.069556 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 437/869] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:43:40 2022] GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 20:43:41.987217 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-b2e999df-65fe-4c05-a2a0-2b9e1779c51a tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "06bad203-ec73-4284-80af-e700d75aa759"}} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:43:41.988351 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-b2e999df-65fe-4c05-a2a0-2b9e1779c51a tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 0b11cb14-b513-4341-a418-ddf26c9e464e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:41.995092 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b2e999df-65fe-4c05-a2a0-2b9e1779c51a tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:41.995479 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b2e999df-65fe-4c05-a2a0-2b9e1779c51a tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:41.996224 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b2e999df-65fe-4c05-a2a0-2b9e1779c51a tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:41.996699 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b2e999df-65fe-4c05-a2a0-2b9e1779c51a tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:42.000312 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:43:42.089408 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-747bb2e4-fb5e-4ab4-8729-4965ada041ab tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:42.090029 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-747bb2e4-fb5e-4ab4-8729-4965ada041ab tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 526626a0-8b46-4f4a-9371-4b310ac67640] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:42.097560 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-747bb2e4-fb5e-4ab4-8729-4965ada041ab tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:42.098012 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-747bb2e4-fb5e-4ab4-8729-4965ada041ab tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:42.098796 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-747bb2e4-fb5e-4ab4-8729-4965ada041ab tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:42.099246 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-747bb2e4-fb5e-4ab4-8729-4965ada041ab tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:42.236533 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-747bb2e4-fb5e-4ab4-8729-4965ada041ab tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:42.245493 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-747bb2e4-fb5e-4ab4-8729-4965ada041ab tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:42.247128 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-747bb2e4-fb5e-4ab4-8729-4965ada041ab tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:42.248297 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-747bb2e4-fb5e-4ab4-8729-4965ada041ab tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640" status: 200 len: 1723 microversion: 2.20 time: 0.162773 Jul 15 20:43:42.248884 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 438/870] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:43:42 2022] GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 20:43:42.254657 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-b2e999df-65fe-4c05-a2a0-2b9e1779c51a tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "POST /compute/v2.1/servers/0b11cb14-b513-4341-a418-ddf26c9e464e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.271965 Jul 15 20:43:42.255246 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 433/871] 10.222.0.66 () {60 vars in 1322 bytes} [Fri Jul 15 20:43:41 2022] POST /compute/v2.1/servers/0b11cb14-b513-4341-a418-ddf26c9e464e/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:43:43.267954 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-e1e7e255-7a20-4e3c-ba81-f52a4eeca71a tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:43.268524 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-e1e7e255-7a20-4e3c-ba81-f52a4eeca71a tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 526626a0-8b46-4f4a-9371-4b310ac67640] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:43.275096 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e1e7e255-7a20-4e3c-ba81-f52a4eeca71a tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:43.276045 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e1e7e255-7a20-4e3c-ba81-f52a4eeca71a tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:43.277114 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e1e7e255-7a20-4e3c-ba81-f52a4eeca71a tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:43.277554 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e1e7e255-7a20-4e3c-ba81-f52a4eeca71a tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:43.411049 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-e1e7e255-7a20-4e3c-ba81-f52a4eeca71a tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:43.421241 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-e1e7e255-7a20-4e3c-ba81-f52a4eeca71a tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:43.422723 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-e1e7e255-7a20-4e3c-ba81-f52a4eeca71a tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:43.423855 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-e1e7e255-7a20-4e3c-ba81-f52a4eeca71a tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640" status: 200 len: 1723 microversion: 2.20 time: 0.160338 Jul 15 20:43:43.424433 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 439/872] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:43:43 2022] GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:43:44.443182 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-4e89ad8e-b120-4b54-a2d9-b0b98265ad6e tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:44.444580 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-4e89ad8e-b120-4b54-a2d9-b0b98265ad6e tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 526626a0-8b46-4f4a-9371-4b310ac67640] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:44.453333 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-4e89ad8e-b120-4b54-a2d9-b0b98265ad6e tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:44.454142 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-4e89ad8e-b120-4b54-a2d9-b0b98265ad6e tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:44.455064 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-4e89ad8e-b120-4b54-a2d9-b0b98265ad6e tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:44.455591 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-4e89ad8e-b120-4b54-a2d9-b0b98265ad6e tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:44.650071 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-4e89ad8e-b120-4b54-a2d9-b0b98265ad6e tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:44.658736 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-4e89ad8e-b120-4b54-a2d9-b0b98265ad6e tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:44.660256 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-4e89ad8e-b120-4b54-a2d9-b0b98265ad6e tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:44.661443 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-4e89ad8e-b120-4b54-a2d9-b0b98265ad6e tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640" status: 200 len: 1723 microversion: 2.20 time: 0.223193 Jul 15 20:43:44.662003 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 434/873] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:43:44 2022] GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640 => generated 1723 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:43:45.679465 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-774bfa0f-3536-4956-ada4-bbe6dc6a2672 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:45.680071 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-774bfa0f-3536-4956-ada4-bbe6dc6a2672 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 526626a0-8b46-4f4a-9371-4b310ac67640] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:45.686803 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-774bfa0f-3536-4956-ada4-bbe6dc6a2672 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:45.687253 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-774bfa0f-3536-4956-ada4-bbe6dc6a2672 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:45.688021 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-774bfa0f-3536-4956-ada4-bbe6dc6a2672 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:45.688479 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-774bfa0f-3536-4956-ada4-bbe6dc6a2672 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:45.823594 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-774bfa0f-3536-4956-ada4-bbe6dc6a2672 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:45.835318 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-774bfa0f-3536-4956-ada4-bbe6dc6a2672 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:45.836859 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-774bfa0f-3536-4956-ada4-bbe6dc6a2672 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:45.838081 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-774bfa0f-3536-4956-ada4-bbe6dc6a2672 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640" status: 200 len: 1723 microversion: 2.20 time: 0.162407 Jul 15 20:43:45.838670 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 440/874] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:43:45 2022] GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:43:46.856319 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-3850c1ab-6d16-48a7-bba4-c23238972392 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:46.856883 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-3850c1ab-6d16-48a7-bba4-c23238972392 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 526626a0-8b46-4f4a-9371-4b310ac67640] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:46.863272 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-3850c1ab-6d16-48a7-bba4-c23238972392 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:46.863715 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-3850c1ab-6d16-48a7-bba4-c23238972392 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:46.864500 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-3850c1ab-6d16-48a7-bba4-c23238972392 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:46.864928 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-3850c1ab-6d16-48a7-bba4-c23238972392 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:46.992527 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-3850c1ab-6d16-48a7-bba4-c23238972392 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:47.000818 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-3850c1ab-6d16-48a7-bba4-c23238972392 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:47.002335 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-3850c1ab-6d16-48a7-bba4-c23238972392 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:47.003481 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-3850c1ab-6d16-48a7-bba4-c23238972392 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640" status: 200 len: 1723 microversion: 2.20 time: 0.151770 Jul 15 20:43:47.004033 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 435/875] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:43:46 2022] GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:43:48.021762 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-a3974551-5fdf-47bf-9dfa-a2f13cad7b4e tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:48.022375 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-a3974551-5fdf-47bf-9dfa-a2f13cad7b4e tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 526626a0-8b46-4f4a-9371-4b310ac67640] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:48.031484 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a3974551-5fdf-47bf-9dfa-a2f13cad7b4e tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:48.031943 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a3974551-5fdf-47bf-9dfa-a2f13cad7b4e tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:48.032745 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a3974551-5fdf-47bf-9dfa-a2f13cad7b4e tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:48.033182 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a3974551-5fdf-47bf-9dfa-a2f13cad7b4e tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:48.162155 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-a3974551-5fdf-47bf-9dfa-a2f13cad7b4e tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:48.171387 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-a3974551-5fdf-47bf-9dfa-a2f13cad7b4e tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:48.172804 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-a3974551-5fdf-47bf-9dfa-a2f13cad7b4e tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:48.174043 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-a3974551-5fdf-47bf-9dfa-a2f13cad7b4e tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640" status: 200 len: 1723 microversion: 2.20 time: 0.156579 Jul 15 20:43:48.174800 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 441/876] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:43:48 2022] GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:43:49.191995 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-871b1274-f870-4727-8688-bd48120619fb tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:49.192635 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-871b1274-f870-4727-8688-bd48120619fb tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 526626a0-8b46-4f4a-9371-4b310ac67640] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:49.195077 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_api:SELECT=40 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:43:49.201293 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-871b1274-f870-4727-8688-bd48120619fb tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:49.201749 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-871b1274-f870-4727-8688-bd48120619fb tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:49.202517 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-871b1274-f870-4727-8688-bd48120619fb tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:49.202964 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-871b1274-f870-4727-8688-bd48120619fb tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:49.356002 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-871b1274-f870-4727-8688-bd48120619fb tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:49.365080 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-871b1274-f870-4727-8688-bd48120619fb tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:49.366786 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-871b1274-f870-4727-8688-bd48120619fb tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:49.368115 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-871b1274-f870-4727-8688-bd48120619fb tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640" status: 200 len: 1723 microversion: 2.20 time: 0.179960 Jul 15 20:43:49.368932 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 436/877] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:43:49 2022] GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:43:49.757616 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-a8eefc89-b5e3-498e-9099-3c44da70b48e tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:49.758707 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-a8eefc89-b5e3-498e-9099-3c44da70b48e tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 0b11cb14-b513-4341-a418-ddf26c9e464e] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:49.766530 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a8eefc89-b5e3-498e-9099-3c44da70b48e tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:49.767074 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a8eefc89-b5e3-498e-9099-3c44da70b48e tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:49.767982 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a8eefc89-b5e3-498e-9099-3c44da70b48e tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:49.768513 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a8eefc89-b5e3-498e-9099-3c44da70b48e tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:49.801019 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-a8eefc89-b5e3-498e-9099-3c44da70b48e tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/0b11cb14-b513-4341-a418-ddf26c9e464e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047296 Jul 15 20:43:49.801605 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 442/878] 10.222.0.66 () {58 vars in 1301 bytes} [Fri Jul 15 20:43:49 2022] GET /compute/v2.1/servers/0b11cb14-b513-4341-a418-ddf26c9e464e/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 20:43:49.938279 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-8148d9cb-294b-496c-8a4a-6c21b60fe74f tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:49.938866 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-8148d9cb-294b-496c-8a4a-6c21b60fe74f tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 0b11cb14-b513-4341-a418-ddf26c9e464e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:49.944978 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8148d9cb-294b-496c-8a4a-6c21b60fe74f tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:49.945430 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8148d9cb-294b-496c-8a4a-6c21b60fe74f tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:49.946200 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8148d9cb-294b-496c-8a4a-6c21b60fe74f tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:49.946634 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8148d9cb-294b-496c-8a4a-6c21b60fe74f tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:49.985293 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-8148d9cb-294b-496c-8a4a-6c21b60fe74f tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/0b11cb14-b513-4341-a418-ddf26c9e464e/os-volume_attachments/41419fef-b337-4c95-b756-25f1f2dd3727" status: 200 len: 194 microversion: 2.1 time: 0.050855 Jul 15 20:43:49.986341 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 437/879] 10.222.0.66 () {58 vars in 1412 bytes} [Fri Jul 15 20:43:49 2022] GET /compute/v2.1/servers/0b11cb14-b513-4341-a418-ddf26c9e464e/os-volume_attachments/41419fef-b337-4c95-b756-25f1f2dd3727 => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:43:49.996161 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-40fc8a4e-c03e-4dee-97bf-70a71db9c25e tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:49.996904 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-40fc8a4e-c03e-4dee-97bf-70a71db9c25e tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 0b11cb14-b513-4341-a418-ddf26c9e464e] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:50.003865 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-40fc8a4e-c03e-4dee-97bf-70a71db9c25e tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:50.004415 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-40fc8a4e-c03e-4dee-97bf-70a71db9c25e tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:50.005383 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-40fc8a4e-c03e-4dee-97bf-70a71db9c25e tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:50.005994 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-40fc8a4e-c03e-4dee-97bf-70a71db9c25e tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:50.090142 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.objects.instance [None req-40fc8a4e-c03e-4dee-97bf-70a71db9c25e tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lazy-loading 'services' on Instance uuid 0b11cb14-b513-4341-a418-ddf26c9e464e {{(pid=124432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 20:43:50.168790 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-40fc8a4e-c03e-4dee-97bf-70a71db9c25e tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "DELETE /compute/v2.1/servers/0b11cb14-b513-4341-a418-ddf26c9e464e/os-volume_attachments/41419fef-b337-4c95-b756-25f1f2dd3727" status: 202 len: 0 microversion: 2.1 time: 0.176805 Jul 15 20:43:50.169593 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 443/880] 10.222.0.66 () {58 vars in 1415 bytes} [Fri Jul 15 20:43:49 2022] DELETE /compute/v2.1/servers/0b11cb14-b513-4341-a418-ddf26c9e464e/os-volume_attachments/41419fef-b337-4c95-b756-25f1f2dd3727 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 20:43:50.386349 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-bf7fd4d1-d48f-419c-8c36-b340372f1db4 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:50.386960 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-bf7fd4d1-d48f-419c-8c36-b340372f1db4 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 526626a0-8b46-4f4a-9371-4b310ac67640] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:50.393392 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-bf7fd4d1-d48f-419c-8c36-b340372f1db4 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:50.393846 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-bf7fd4d1-d48f-419c-8c36-b340372f1db4 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:50.394612 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-bf7fd4d1-d48f-419c-8c36-b340372f1db4 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:50.395122 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-bf7fd4d1-d48f-419c-8c36-b340372f1db4 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:50.529868 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-bf7fd4d1-d48f-419c-8c36-b340372f1db4 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:50.538927 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-bf7fd4d1-d48f-419c-8c36-b340372f1db4 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:50.541772 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-bf7fd4d1-d48f-419c-8c36-b340372f1db4 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:50.543258 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-bf7fd4d1-d48f-419c-8c36-b340372f1db4 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640" status: 200 len: 1723 microversion: 2.20 time: 0.160737 Jul 15 20:43:50.544045 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 438/881] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:43:50 2022] GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:43:51.562773 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-e4ac71af-eb22-4b80-a155-b6de379ef432 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:51.563484 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-e4ac71af-eb22-4b80-a155-b6de379ef432 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 526626a0-8b46-4f4a-9371-4b310ac67640] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:51.569751 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e4ac71af-eb22-4b80-a155-b6de379ef432 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:51.570194 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e4ac71af-eb22-4b80-a155-b6de379ef432 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:51.570950 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e4ac71af-eb22-4b80-a155-b6de379ef432 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:51.571376 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e4ac71af-eb22-4b80-a155-b6de379ef432 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:51.702415 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-e4ac71af-eb22-4b80-a155-b6de379ef432 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:51.710251 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-e4ac71af-eb22-4b80-a155-b6de379ef432 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:51.711773 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-e4ac71af-eb22-4b80-a155-b6de379ef432 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:51.713000 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-e4ac71af-eb22-4b80-a155-b6de379ef432 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640" status: 200 len: 1744 microversion: 2.20 time: 0.155025 Jul 15 20:43:51.713548 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 444/882] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:43:51 2022] GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640 => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:43:52.355085 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-ca702594-cdbb-4bc4-84e4-21e9c9019521 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:52.355590 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-ca702594-cdbb-4bc4-84e4-21e9c9019521 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 0b11cb14-b513-4341-a418-ddf26c9e464e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:52.362183 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-ca702594-cdbb-4bc4-84e4-21e9c9019521 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:52.362634 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-ca702594-cdbb-4bc4-84e4-21e9c9019521 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:52.363401 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-ca702594-cdbb-4bc4-84e4-21e9c9019521 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:52.363838 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-ca702594-cdbb-4bc4-84e4-21e9c9019521 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:52.392901 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-ca702594-cdbb-4bc4-84e4-21e9c9019521 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/0b11cb14-b513-4341-a418-ddf26c9e464e/os-volume_attachments/06bad203-ec73-4284-80af-e700d75aa759" status: 200 len: 194 microversion: 2.1 time: 0.042490 Jul 15 20:43:52.393760 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 439/883] 10.222.0.66 () {58 vars in 1412 bytes} [Fri Jul 15 20:43:52 2022] GET /compute/v2.1/servers/0b11cb14-b513-4341-a418-ddf26c9e464e/os-volume_attachments/06bad203-ec73-4284-80af-e700d75aa759 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:43:52.403202 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-3a0c89db-4e9a-42e8-b784-1d9c6ae11d37 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:52.403757 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-3a0c89db-4e9a-42e8-b784-1d9c6ae11d37 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 0b11cb14-b513-4341-a418-ddf26c9e464e] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:52.409601 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3a0c89db-4e9a-42e8-b784-1d9c6ae11d37 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:52.410107 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3a0c89db-4e9a-42e8-b784-1d9c6ae11d37 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:52.410924 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3a0c89db-4e9a-42e8-b784-1d9c6ae11d37 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:52.411418 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3a0c89db-4e9a-42e8-b784-1d9c6ae11d37 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:52.502308 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.objects.instance [None req-3a0c89db-4e9a-42e8-b784-1d9c6ae11d37 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lazy-loading 'services' on Instance uuid 0b11cb14-b513-4341-a418-ddf26c9e464e {{(pid=124432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 20:43:52.604900 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-3a0c89db-4e9a-42e8-b784-1d9c6ae11d37 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "DELETE /compute/v2.1/servers/0b11cb14-b513-4341-a418-ddf26c9e464e/os-volume_attachments/06bad203-ec73-4284-80af-e700d75aa759" status: 202 len: 0 microversion: 2.1 time: 0.204275 Jul 15 20:43:52.606614 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 445/884] 10.222.0.66 () {58 vars in 1415 bytes} [Fri Jul 15 20:43:52 2022] DELETE /compute/v2.1/servers/0b11cb14-b513-4341-a418-ddf26c9e464e/os-volume_attachments/06bad203-ec73-4284-80af-e700d75aa759 => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 20:43:52.732630 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-afd21bf0-3350-4db0-be22-78252aa76880 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:52.733456 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-afd21bf0-3350-4db0-be22-78252aa76880 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 526626a0-8b46-4f4a-9371-4b310ac67640] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:52.742887 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-afd21bf0-3350-4db0-be22-78252aa76880 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:52.743345 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-afd21bf0-3350-4db0-be22-78252aa76880 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:52.744260 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-afd21bf0-3350-4db0-be22-78252aa76880 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:52.744903 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-afd21bf0-3350-4db0-be22-78252aa76880 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:52.883270 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-afd21bf0-3350-4db0-be22-78252aa76880 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:52.891818 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-afd21bf0-3350-4db0-be22-78252aa76880 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:52.893338 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-afd21bf0-3350-4db0-be22-78252aa76880 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:52.894496 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-afd21bf0-3350-4db0-be22-78252aa76880 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640" status: 200 len: 1744 microversion: 2.20 time: 0.166898 Jul 15 20:43:52.895044 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 440/885] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:43:52 2022] GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640 => generated 1744 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:43:53.786339 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-617e0bea-f803-4ff0-b53a-3dbb090e8713 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:53.787643 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-617e0bea-f803-4ff0-b53a-3dbb090e8713 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 0b11cb14-b513-4341-a418-ddf26c9e464e] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:53.797041 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-617e0bea-f803-4ff0-b53a-3dbb090e8713 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:53.797680 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-617e0bea-f803-4ff0-b53a-3dbb090e8713 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:53.798456 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-617e0bea-f803-4ff0-b53a-3dbb090e8713 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:53.798895 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-617e0bea-f803-4ff0-b53a-3dbb090e8713 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:53.832890 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-617e0bea-f803-4ff0-b53a-3dbb090e8713 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/0b11cb14-b513-4341-a418-ddf26c9e464e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051162 Jul 15 20:43:53.833656 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 446/886] 10.222.0.66 () {58 vars in 1301 bytes} [Fri Jul 15 20:43:53 2022] GET /compute/v2.1/servers/0b11cb14-b513-4341-a418-ddf26c9e464e/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 15 20:43:53.914509 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-31cbe0c4-ec1d-400f-a529-5e1026e54ae6 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:53.915503 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-31cbe0c4-ec1d-400f-a529-5e1026e54ae6 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 526626a0-8b46-4f4a-9371-4b310ac67640] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:53.922528 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-31cbe0c4-ec1d-400f-a529-5e1026e54ae6 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:53.923077 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-31cbe0c4-ec1d-400f-a529-5e1026e54ae6 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:53.924311 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-31cbe0c4-ec1d-400f-a529-5e1026e54ae6 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:53.924814 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-31cbe0c4-ec1d-400f-a529-5e1026e54ae6 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:53.938409 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-1e7279a8-71d4-493f-855d-8040738a7d8e tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:53.939545 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-1e7279a8-71d4-493f-855d-8040738a7d8e tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 0b11cb14-b513-4341-a418-ddf26c9e464e] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:53.946808 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1e7279a8-71d4-493f-855d-8040738a7d8e tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:53.947978 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1e7279a8-71d4-493f-855d-8040738a7d8e tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:53.948796 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1e7279a8-71d4-493f-855d-8040738a7d8e tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:53.949225 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1e7279a8-71d4-493f-855d-8040738a7d8e tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:53.991251 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-1e7279a8-71d4-493f-855d-8040738a7d8e tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/0b11cb14-b513-4341-a418-ddf26c9e464e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056873 Jul 15 20:43:53.992676 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 447/887] 10.222.0.66 () {58 vars in 1301 bytes} [Fri Jul 15 20:43:53 2022] GET /compute/v2.1/servers/0b11cb14-b513-4341-a418-ddf26c9e464e/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 15 20:43:54.059401 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-e6b6c6a7-7b8a-4905-a148-517aa2c31271 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:54.060303 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-e6b6c6a7-7b8a-4905-a148-517aa2c31271 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 0b11cb14-b513-4341-a418-ddf26c9e464e] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:54.069177 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e6b6c6a7-7b8a-4905-a148-517aa2c31271 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:54.070136 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e6b6c6a7-7b8a-4905-a148-517aa2c31271 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:54.071475 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e6b6c6a7-7b8a-4905-a148-517aa2c31271 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:54.072664 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e6b6c6a7-7b8a-4905-a148-517aa2c31271 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:54.079872 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-31cbe0c4-ec1d-400f-a529-5e1026e54ae6 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:54.089418 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-31cbe0c4-ec1d-400f-a529-5e1026e54ae6 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:54.090978 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-31cbe0c4-ec1d-400f-a529-5e1026e54ae6 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:54.092157 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-31cbe0c4-ec1d-400f-a529-5e1026e54ae6 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640" status: 200 len: 1739 microversion: 2.20 time: 0.182368 Jul 15 20:43:54.092736 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 441/888] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:43:53 2022] GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640 => generated 1739 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 20:43:54.107836 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-e6b6c6a7-7b8a-4905-a148-517aa2c31271 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 0b11cb14-b513-4341-a418-ddf26c9e464e] Going to try to terminate instance {{(pid=124432) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 20:43:54.122652 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:43:54.190119 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-e6b6c6a7-7b8a-4905-a148-517aa2c31271 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "DELETE /compute/v2.1/servers/0b11cb14-b513-4341-a418-ddf26c9e464e" status: 204 len: 0 microversion: 2.1 time: 0.135780 Jul 15 20:43:54.190773 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 448/889] 10.222.0.66 () {58 vars in 1238 bytes} [Fri Jul 15 20:43:54 2022] DELETE /compute/v2.1/servers/0b11cb14-b513-4341-a418-ddf26c9e464e => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 15 20:43:54.199686 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-4e33625c-e121-4c91-b9cc-2fa1eabf5cca tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:54.200593 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-4e33625c-e121-4c91-b9cc-2fa1eabf5cca tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 0b11cb14-b513-4341-a418-ddf26c9e464e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:54.206856 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-4e33625c-e121-4c91-b9cc-2fa1eabf5cca tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:54.207423 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-4e33625c-e121-4c91-b9cc-2fa1eabf5cca tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:54.208258 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-4e33625c-e121-4c91-b9cc-2fa1eabf5cca tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:54.208784 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-4e33625c-e121-4c91-b9cc-2fa1eabf5cca tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:54.356659 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-4e33625c-e121-4c91-b9cc-2fa1eabf5cca tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d12a685d9b419fa3606b5f4d1309fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af209f962144de4ae7e3575a3890096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:54.364794 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-4e33625c-e121-4c91-b9cc-2fa1eabf5cca tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/0b11cb14-b513-4341-a418-ddf26c9e464e" status: 200 len: 1674 microversion: 2.1 time: 0.169752 Jul 15 20:43:54.365735 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 442/890] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:43:54 2022] GET /compute/v2.1/servers/0b11cb14-b513-4341-a418-ddf26c9e464e => generated 1674 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:43:54.611648 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-162f72e2-f02a-4e21-9c3e-c4fa10040544 req-7fd326a2-da66-41fb-a75b-fbd846f4963d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "526626a0-8b46-4f4a-9371-4b310ac67640", "name": "network-vif-plugged", "status": "completed", "tag": "d578337d-2376-4543-8227-625279e42cf8"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:43:54.625534 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-162f72e2-f02a-4e21-9c3e-c4fa10040544 req-7fd326a2-da66-41fb-a75b-fbd846f4963d service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:54.626646 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-162f72e2-f02a-4e21-9c3e-c4fa10040544 req-7fd326a2-da66-41fb-a75b-fbd846f4963d service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:54.641833 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-162f72e2-f02a-4e21-9c3e-c4fa10040544 req-7fd326a2-da66-41fb-a75b-fbd846f4963d service nova] Creating event network-vif-plugged:d578337d-2376-4543-8227-625279e42cf8 for instance 526626a0-8b46-4f4a-9371-4b310ac67640 on hv-cinder-79987 Jul 15 20:43:54.646884 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-162f72e2-f02a-4e21-9c3e-c4fa10040544 req-7fd326a2-da66-41fb-a75b-fbd846f4963d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039263 Jul 15 20:43:54.647837 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 449/891] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:43:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:43:55.112128 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-b6fc059e-d2ab-4145-973b-8fbeec443f96 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:55.112928 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-b6fc059e-d2ab-4145-973b-8fbeec443f96 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 526626a0-8b46-4f4a-9371-4b310ac67640] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:55.120200 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b6fc059e-d2ab-4145-973b-8fbeec443f96 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:55.120609 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b6fc059e-d2ab-4145-973b-8fbeec443f96 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:55.121588 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b6fc059e-d2ab-4145-973b-8fbeec443f96 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:55.122017 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b6fc059e-d2ab-4145-973b-8fbeec443f96 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:55.275178 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-b6fc059e-d2ab-4145-973b-8fbeec443f96 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:55.287229 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-b6fc059e-d2ab-4145-973b-8fbeec443f96 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:55.289048 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-b6fc059e-d2ab-4145-973b-8fbeec443f96 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:55.290471 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-b6fc059e-d2ab-4145-973b-8fbeec443f96 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640" status: 200 len: 1739 microversion: 2.20 time: 0.182650 Jul 15 20:43:55.291630 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 443/892] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:43:55 2022] GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640 => generated 1739 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 20:43:55.383276 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-16b19919-26ba-47d6-a1fa-26887c93227e tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:55.384615 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-16b19919-26ba-47d6-a1fa-26887c93227e tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 0b11cb14-b513-4341-a418-ddf26c9e464e] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:55.391756 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-16b19919-26ba-47d6-a1fa-26887c93227e tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:55.392202 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-16b19919-26ba-47d6-a1fa-26887c93227e tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:55.393000 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-16b19919-26ba-47d6-a1fa-26887c93227e tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:55.393600 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-16b19919-26ba-47d6-a1fa-26887c93227e tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:55.553416 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-16b19919-26ba-47d6-a1fa-26887c93227e tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d12a685d9b419fa3606b5f4d1309fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af209f962144de4ae7e3575a3890096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:55.562569 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-16b19919-26ba-47d6-a1fa-26887c93227e tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/0b11cb14-b513-4341-a418-ddf26c9e464e" status: 200 len: 1674 microversion: 2.1 time: 0.183321 Jul 15 20:43:55.563399 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 450/893] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:43:55 2022] GET /compute/v2.1/servers/0b11cb14-b513-4341-a418-ddf26c9e464e => generated 1674 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:43:56.309918 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-d97a58d3-feb4-43d4-be40-947f1d89c0cf tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:56.311159 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-d97a58d3-feb4-43d4-be40-947f1d89c0cf tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 526626a0-8b46-4f4a-9371-4b310ac67640] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:56.325382 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d97a58d3-feb4-43d4-be40-947f1d89c0cf tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:56.325846 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d97a58d3-feb4-43d4-be40-947f1d89c0cf tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:56.326636 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d97a58d3-feb4-43d4-be40-947f1d89c0cf tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:56.327071 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d97a58d3-feb4-43d4-be40-947f1d89c0cf tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:56.529806 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-d97a58d3-feb4-43d4-be40-947f1d89c0cf tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:56.545221 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-d97a58d3-feb4-43d4-be40-947f1d89c0cf tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:56.547148 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-d97a58d3-feb4-43d4-be40-947f1d89c0cf tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:56.548532 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-d97a58d3-feb4-43d4-be40-947f1d89c0cf tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640" status: 200 len: 1739 microversion: 2.20 time: 0.243349 Jul 15 20:43:56.549654 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 444/894] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:43:56 2022] GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640 => generated 1739 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:43:56.581456 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-6599e846-3e78-49e2-8e8e-82a27c90ae2a tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:56.582651 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-6599e846-3e78-49e2-8e8e-82a27c90ae2a tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 0b11cb14-b513-4341-a418-ddf26c9e464e] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:56.591966 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6599e846-3e78-49e2-8e8e-82a27c90ae2a tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:56.592754 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6599e846-3e78-49e2-8e8e-82a27c90ae2a tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:56.593720 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6599e846-3e78-49e2-8e8e-82a27c90ae2a tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:56.594309 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6599e846-3e78-49e2-8e8e-82a27c90ae2a tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:56.764748 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-6599e846-3e78-49e2-8e8e-82a27c90ae2a tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d12a685d9b419fa3606b5f4d1309fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af209f962144de4ae7e3575a3890096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:56.773376 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-6599e846-3e78-49e2-8e8e-82a27c90ae2a tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/0b11cb14-b513-4341-a418-ddf26c9e464e" status: 200 len: 1674 microversion: 2.1 time: 0.196425 Jul 15 20:43:56.776492 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 451/895] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:43:56 2022] GET /compute/v2.1/servers/0b11cb14-b513-4341-a418-ddf26c9e464e => generated 1674 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:43:57.297840 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [req-e82e764c-0f23-4ae2-a9b2-d6fc75c47c2c req-ddc0454d-d675-4642-be6f-4fa32c4506be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b11cb14-b513-4341-a418-ddf26c9e464e", "name": "network-vif-deleted", "tag": "ee939cda-b869-4fbe-96c0-c0ea588ff114"}]} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:43:57.314118 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-e82e764c-0f23-4ae2-a9b2-d6fc75c47c2c req-ddc0454d-d675-4642-be6f-4fa32c4506be service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:57.315335 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-e82e764c-0f23-4ae2-a9b2-d6fc75c47c2c req-ddc0454d-d675-4642-be6f-4fa32c4506be service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:57.330847 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.compute.server_external_events [req-e82e764c-0f23-4ae2-a9b2-d6fc75c47c2c req-ddc0454d-d675-4642-be6f-4fa32c4506be service nova] Creating event network-vif-deleted:ee939cda-b869-4fbe-96c0-c0ea588ff114 for instance 0b11cb14-b513-4341-a418-ddf26c9e464e on hv-cinder-79987 Jul 15 20:43:57.338153 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [req-e82e764c-0f23-4ae2-a9b2-d6fc75c47c2c req-ddc0454d-d675-4642-be6f-4fa32c4506be service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043675 Jul 15 20:43:57.342190 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 445/896] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:43:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:43:57.583865 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-1735ca4b-bc30-4131-bf1d-89e3a6fe2d03 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:57.585101 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-1735ca4b-bc30-4131-bf1d-89e3a6fe2d03 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 526626a0-8b46-4f4a-9371-4b310ac67640] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:57.603545 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1735ca4b-bc30-4131-bf1d-89e3a6fe2d03 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:57.604013 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1735ca4b-bc30-4131-bf1d-89e3a6fe2d03 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:57.604907 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1735ca4b-bc30-4131-bf1d-89e3a6fe2d03 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:57.605348 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1735ca4b-bc30-4131-bf1d-89e3a6fe2d03 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:57.794430 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-1002a59d-2a0a-4ee5-a82c-eaef17c4adb5 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:57.795366 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-1002a59d-2a0a-4ee5-a82c-eaef17c4adb5 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 0b11cb14-b513-4341-a418-ddf26c9e464e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:57.811336 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-1002a59d-2a0a-4ee5-a82c-eaef17c4adb5 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:57.815005 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-1002a59d-2a0a-4ee5-a82c-eaef17c4adb5 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:57.816060 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-1002a59d-2a0a-4ee5-a82c-eaef17c4adb5 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:57.816690 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-1002a59d-2a0a-4ee5-a82c-eaef17c4adb5 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:57.882878 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-1002a59d-2a0a-4ee5-a82c-eaef17c4adb5 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:57.883670 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-1002a59d-2a0a-4ee5-a82c-eaef17c4adb5 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:57.884703 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.objects.instance [None req-1002a59d-2a0a-4ee5-a82c-eaef17c4adb5 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lazy-loading 'fault' on Instance uuid 0b11cb14-b513-4341-a418-ddf26c9e464e {{(pid=124430) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 20:43:58.047910 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-1735ca4b-bc30-4131-bf1d-89e3a6fe2d03 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:58.062019 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-1735ca4b-bc30-4131-bf1d-89e3a6fe2d03 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:58.062267 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-1002a59d-2a0a-4ee5-a82c-eaef17c4adb5 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d12a685d9b419fa3606b5f4d1309fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af209f962144de4ae7e3575a3890096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:58.063910 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-1735ca4b-bc30-4131-bf1d-89e3a6fe2d03 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:58.065390 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-1735ca4b-bc30-4131-bf1d-89e3a6fe2d03 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640" status: 200 len: 1739 microversion: 2.20 time: 0.502228 Jul 15 20:43:58.075728 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-1002a59d-2a0a-4ee5-a82c-eaef17c4adb5 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/0b11cb14-b513-4341-a418-ddf26c9e464e" status: 200 len: 1328 microversion: 2.1 time: 0.285125 Jul 15 20:43:58.078751 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 452/897] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:43:57 2022] GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640 => generated 1739 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:43:58.101425 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 446/898] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:43:57 2022] GET /compute/v2.1/servers/0b11cb14-b513-4341-a418-ddf26c9e464e => generated 1328 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:43:59.086977 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-b0d336a2-fd96-4552-a68d-7e6c2ec3516f tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:59.088179 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-b0d336a2-fd96-4552-a68d-7e6c2ec3516f tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 526626a0-8b46-4f4a-9371-4b310ac67640] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:59.095456 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b0d336a2-fd96-4552-a68d-7e6c2ec3516f tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:59.095909 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b0d336a2-fd96-4552-a68d-7e6c2ec3516f tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:59.096709 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b0d336a2-fd96-4552-a68d-7e6c2ec3516f tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:59.097382 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b0d336a2-fd96-4552-a68d-7e6c2ec3516f tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:59.112649 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-09e07ede-9c15-4d60-a064-57aced09628b tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:59.113396 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-09e07ede-9c15-4d60-a064-57aced09628b tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 0b11cb14-b513-4341-a418-ddf26c9e464e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:43:59.121163 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-09e07ede-9c15-4d60-a064-57aced09628b tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:59.124039 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-09e07ede-9c15-4d60-a064-57aced09628b tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:59.124935 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-09e07ede-9c15-4d60-a064-57aced09628b tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:43:59.125379 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-09e07ede-9c15-4d60-a064-57aced09628b tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:43:59.142804 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.wsgi [None req-09e07ede-9c15-4d60-a064-57aced09628b tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] HTTP exception thrown: Instance 0b11cb14-b513-4341-a418-ddf26c9e464e could not be found. Jul 15 20:43:59.144801 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-09e07ede-9c15-4d60-a064-57aced09628b tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Request method failure captured: Jul 15 20:43:59.144801 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: request: GET /compute/v2.1/servers/0b11cb14-b513-4341-a418-ddf26c9e464e HTTP/1.1 Jul 15 20:43:59.144801 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Accept: application/json Jul 15 20:43:59.144801 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Accept-Encoding: identity Jul 15 20:43:59.144801 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Connection: close Jul 15 20:43:59.144801 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Content-Length: 0 Jul 15 20:43:59.144801 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Content-Type: application/json Jul 15 20:43:59.144801 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Host: 10.222.0.66 Jul 15 20:43:59.144801 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Openstack-System-Scope: None Jul 15 20:43:59.144801 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: User-Agent: python-urllib3/1.26.9 Jul 15 20:43:59.144801 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Auth-Token: gAAAAABi0dBEFjFrdM-t1qn2GVlnIzLFPzEiMCH376b_bq8y8sAU95pWU5rp8WQ4Pzq9aTBnJ2670jBZzG_1C1hPpW20abHkue1szruQ7QW9zRDMObf8WqD4Ko1amQUqwrnk9woNQQT1EHUnoNbLh_TGl4IWhyGUHaJEpKT3PlNLBZc2iT-X8Mk Jul 15 20:43:59.144801 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Domain-Id: None Jul 15 20:43:59.144801 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Domain-Name: None Jul 15 20:43:59.144801 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Identity-Status: Confirmed Jul 15 20:43:59.144801 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Is-Admin-Project: True Jul 15 20:43:59.144801 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Domain-Id: default Jul 15 20:43:59.144801 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Domain-Name: Default Jul 15 20:43:59.144801 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Id: 9af209f962144de4ae7e3575a3890096 Jul 15 20:43:59.144801 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Name: tempest-AttachVolumeTestJSON-1635157670 Jul 15 20:43:59.144801 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Role: member,reader Jul 15 20:43:59.144801 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Roles: member,reader Jul 15 20:43:59.146578 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9af209f962144de4ae7e3575a3890096"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9af209f962144de4ae7e3575a3890096"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9af209f962144de4ae7e3575a3890096"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9af209f962144de4ae7e3575a3890096"}]}] Jul 15 20:43:59.146578 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant: tempest-AttachVolumeTestJSON-1635157670 Jul 15 20:43:59.146578 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant-Id: 9af209f962144de4ae7e3575a3890096 Jul 15 20:43:59.146578 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1635157670 Jul 15 20:43:59.146578 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User: tempest-AttachVolumeTestJSON-1635157670-project Jul 15 20:43:59.146578 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Domain-Id: default Jul 15 20:43:59.146578 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Domain-Name: Default Jul 15 20:43:59.146578 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Id: 75d12a685d9b419fa3606b5f4d1309fe Jul 15 20:43:59.146578 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Name: tempest-AttachVolumeTestJSON-1635157670-project Jul 15 20:43:59.146578 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: method: > Jul 15 20:43:59.146578 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: exception: Instance 0b11cb14-b513-4341-a418-ddf26c9e464e could not be found. Jul 15 20:43:59.146578 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: action_args: {'id': '0b11cb14-b513-4341-a418-ddf26c9e464e'} Jul 15 20:43:59.147540 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 20:43:59.147540 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:43:59.147540 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 20:43:59.147540 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 20:43:59.147540 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 20:43:59.147540 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 20:43:59.147540 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 20:43:59.147540 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 20:43:59.147540 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 20:43:59.147540 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 20:43:59.147540 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b11cb14-b513-4341-a418-ddf26c9e464e could not be found. Jul 15 20:43:59.147540 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:43:59.147540 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:43:59.147540 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:43:59.147540 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:43:59.147540 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:43:59.147540 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:43:59.147540 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 20:43:59.147540 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 20:43:59.147540 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 20:43:59.149386 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 20:43:59.149386 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 20:43:59.149386 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 20:43:59.149386 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 20:43:59.149386 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 20:43:59.149386 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 20:43:59.149386 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 20:43:59.149386 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b11cb14-b513-4341-a418-ddf26c9e464e could not be found. Jul 15 20:43:59.149386 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:43:59.149386 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:43:59.149386 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:43:59.149386 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:43:59.149386 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:43:59.149386 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:43:59.149386 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 20:43:59.149386 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 20:43:59.149386 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b11cb14-b513-4341-a418-ddf26c9e464e could not be found. Jul 15 20:43:59.149386 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:43:59.154735 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-09e07ede-9c15-4d60-a064-57aced09628b tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Returning 404 to user: Instance 0b11cb14-b513-4341-a418-ddf26c9e464e could not be found. {{(pid=124430) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 20:43:59.155782 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-09e07ede-9c15-4d60-a064-57aced09628b tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/0b11cb14-b513-4341-a418-ddf26c9e464e" status: 404 len: 111 microversion: 2.1 time: 0.051827 Jul 15 20:43:59.156533 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 447/899] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:43:59 2022] GET /compute/v2.1/servers/0b11cb14-b513-4341-a418-ddf26c9e464e => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 20:43:59.166618 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-cbe9a152-2dc1-4676-843c-5716cd8973e5 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '.version_select at 0x7ff518107e50>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:43:59.193742 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-cbe9a152-2dc1-4676-843c-5716cd8973e5 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1471088480" status: 202 len: 0 microversion: 2.1 time: 0.032181 Jul 15 20:43:59.194669 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 448/900] 10.222.0.66 () {58 vars in 1220 bytes} [Fri Jul 15 20:43:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1471088480 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 20:43:59.304831 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-b0d336a2-fd96-4552-a68d-7e6c2ec3516f tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:59.316496 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-b0d336a2-fd96-4552-a68d-7e6c2ec3516f tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:59.319107 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-b0d336a2-fd96-4552-a68d-7e6c2ec3516f tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:43:59.321216 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-b0d336a2-fd96-4552-a68d-7e6c2ec3516f tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640" status: 200 len: 1739 microversion: 2.20 time: 0.238491 Jul 15 20:43:59.333579 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 453/901] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:43:59 2022] GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640 => generated 1739 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:44:00.341548 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-79401a56-a0fa-4152-bae2-4dec871c4096 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:44:00.342324 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-79401a56-a0fa-4152-bae2-4dec871c4096 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 526626a0-8b46-4f4a-9371-4b310ac67640] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:44:00.350237 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-79401a56-a0fa-4152-bae2-4dec871c4096 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:44:00.350699 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-79401a56-a0fa-4152-bae2-4dec871c4096 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:44:00.351473 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-79401a56-a0fa-4152-bae2-4dec871c4096 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:44:00.351911 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-79401a56-a0fa-4152-bae2-4dec871c4096 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:44:00.495844 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-79401a56-a0fa-4152-bae2-4dec871c4096 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:00.507400 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-79401a56-a0fa-4152-bae2-4dec871c4096 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:00.508960 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-79401a56-a0fa-4152-bae2-4dec871c4096 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:00.511384 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-79401a56-a0fa-4152-bae2-4dec871c4096 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640" status: 200 len: 1739 microversion: 2.20 time: 0.175664 Jul 15 20:44:00.511929 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 449/902] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:44:00 2022] GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640 => generated 1739 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:44:01.529589 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-38773abc-ed2e-4c85-afc3-3f32d6f25882 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:44:01.530980 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-38773abc-ed2e-4c85-afc3-3f32d6f25882 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 526626a0-8b46-4f4a-9371-4b310ac67640] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:44:01.541146 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-38773abc-ed2e-4c85-afc3-3f32d6f25882 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:44:01.541846 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-38773abc-ed2e-4c85-afc3-3f32d6f25882 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:44:01.543093 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-38773abc-ed2e-4c85-afc3-3f32d6f25882 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:44:01.543733 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-38773abc-ed2e-4c85-afc3-3f32d6f25882 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:44:01.718344 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-38773abc-ed2e-4c85-afc3-3f32d6f25882 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:01.728459 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-38773abc-ed2e-4c85-afc3-3f32d6f25882 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:01.730508 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-38773abc-ed2e-4c85-afc3-3f32d6f25882 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:01.732146 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-38773abc-ed2e-4c85-afc3-3f32d6f25882 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640" status: 200 len: 1739 microversion: 2.20 time: 0.206601 Jul 15 20:44:01.732843 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 454/903] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:44:01 2022] GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640 => generated 1739 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:44:02.752436 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-81c8c1d9-56e0-480b-ab38-a1d6ae3c392c tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:44:02.752436 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-81c8c1d9-56e0-480b-ab38-a1d6ae3c392c tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 526626a0-8b46-4f4a-9371-4b310ac67640] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:44:02.761536 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-81c8c1d9-56e0-480b-ab38-a1d6ae3c392c tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:44:02.762121 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-81c8c1d9-56e0-480b-ab38-a1d6ae3c392c tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:44:02.763003 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-81c8c1d9-56e0-480b-ab38-a1d6ae3c392c tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:44:02.763554 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-81c8c1d9-56e0-480b-ab38-a1d6ae3c392c tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:44:02.789125 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:44:02.959712 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-81c8c1d9-56e0-480b-ab38-a1d6ae3c392c tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:02.974223 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-81c8c1d9-56e0-480b-ab38-a1d6ae3c392c tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:02.977388 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-81c8c1d9-56e0-480b-ab38-a1d6ae3c392c tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:02.979471 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-81c8c1d9-56e0-480b-ab38-a1d6ae3c392c tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640" status: 200 len: 1739 microversion: 2.20 time: 0.232472 Jul 15 20:44:02.980302 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 450/904] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:44:02 2022] GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640 => generated 1739 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:44:03.350202 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-9e9a685e-6d92-4c05-9786-5fd087161260 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:44:03.352226 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-9e9a685e-6d92-4c05-9786-5fd087161260 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 0b11cb14-b513-4341-a418-ddf26c9e464e] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:44:03.359781 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9e9a685e-6d92-4c05-9786-5fd087161260 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:44:03.360994 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9e9a685e-6d92-4c05-9786-5fd087161260 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:44:03.361986 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9e9a685e-6d92-4c05-9786-5fd087161260 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:44:03.362432 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9e9a685e-6d92-4c05-9786-5fd087161260 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:44:03.379387 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.wsgi [None req-9e9a685e-6d92-4c05-9786-5fd087161260 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] HTTP exception thrown: Instance 0b11cb14-b513-4341-a418-ddf26c9e464e could not be found. Jul 15 20:44:03.381504 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-9e9a685e-6d92-4c05-9786-5fd087161260 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Request method failure captured: Jul 15 20:44:03.381504 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: request: DELETE /compute/v2.1/servers/0b11cb14-b513-4341-a418-ddf26c9e464e HTTP/1.1 Jul 15 20:44:03.381504 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Accept: application/json Jul 15 20:44:03.381504 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Accept-Encoding: identity Jul 15 20:44:03.381504 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Connection: close Jul 15 20:44:03.381504 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Content-Length: 0 Jul 15 20:44:03.381504 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Content-Type: application/json Jul 15 20:44:03.381504 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Host: 10.222.0.66 Jul 15 20:44:03.381504 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Openstack-System-Scope: None Jul 15 20:44:03.381504 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: User-Agent: python-urllib3/1.26.9 Jul 15 20:44:03.381504 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Auth-Token: gAAAAABi0dBEFjFrdM-t1qn2GVlnIzLFPzEiMCH376b_bq8y8sAU95pWU5rp8WQ4Pzq9aTBnJ2670jBZzG_1C1hPpW20abHkue1szruQ7QW9zRDMObf8WqD4Ko1amQUqwrnk9woNQQT1EHUnoNbLh_TGl4IWhyGUHaJEpKT3PlNLBZc2iT-X8Mk Jul 15 20:44:03.381504 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Domain-Id: None Jul 15 20:44:03.381504 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Domain-Name: None Jul 15 20:44:03.381504 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Identity-Status: Confirmed Jul 15 20:44:03.381504 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Is-Admin-Project: True Jul 15 20:44:03.381504 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Domain-Id: default Jul 15 20:44:03.381504 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Domain-Name: Default Jul 15 20:44:03.381504 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Id: 9af209f962144de4ae7e3575a3890096 Jul 15 20:44:03.381504 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Name: tempest-AttachVolumeTestJSON-1635157670 Jul 15 20:44:03.381504 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Role: member,reader Jul 15 20:44:03.381504 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Roles: member,reader Jul 15 20:44:03.383338 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9af209f962144de4ae7e3575a3890096"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9af209f962144de4ae7e3575a3890096"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9af209f962144de4ae7e3575a3890096"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9af209f962144de4ae7e3575a3890096"}]}] Jul 15 20:44:03.383338 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Tenant: tempest-AttachVolumeTestJSON-1635157670 Jul 15 20:44:03.383338 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Tenant-Id: 9af209f962144de4ae7e3575a3890096 Jul 15 20:44:03.383338 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1635157670 Jul 15 20:44:03.383338 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User: tempest-AttachVolumeTestJSON-1635157670-project Jul 15 20:44:03.383338 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Domain-Id: default Jul 15 20:44:03.383338 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Domain-Name: Default Jul 15 20:44:03.383338 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Id: 75d12a685d9b419fa3606b5f4d1309fe Jul 15 20:44:03.383338 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Name: tempest-AttachVolumeTestJSON-1635157670-project Jul 15 20:44:03.383338 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: method: > Jul 15 20:44:03.383338 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: exception: Instance 0b11cb14-b513-4341-a418-ddf26c9e464e could not be found. Jul 15 20:44:03.383338 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: action_args: {'id': '0b11cb14-b513-4341-a418-ddf26c9e464e'} Jul 15 20:44:03.385077 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 20:44:03.385077 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:44:03.385077 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 20:44:03.385077 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 20:44:03.385077 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 20:44:03.385077 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 20:44:03.385077 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 20:44:03.385077 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 20:44:03.385077 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 20:44:03.385077 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 20:44:03.385077 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b11cb14-b513-4341-a418-ddf26c9e464e could not be found. Jul 15 20:44:03.385077 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:44:03.385077 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:44:03.385077 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:44:03.385077 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:44:03.385077 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:44:03.385077 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:44:03.385077 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 20:44:03.385077 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 20:44:03.385077 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 20:44:03.386582 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 20:44:03.386582 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 15 20:44:03.386582 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 15 20:44:03.386582 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 15 20:44:03.386582 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 15 20:44:03.386582 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 20:44:03.386582 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 20:44:03.386582 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 20:44:03.386582 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 20:44:03.386582 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b11cb14-b513-4341-a418-ddf26c9e464e could not be found. Jul 15 20:44:03.386582 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:44:03.386582 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:44:03.386582 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:44:03.386582 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:44:03.386582 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:44:03.386582 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:44:03.386582 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 20:44:03.386582 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 20:44:03.386582 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b11cb14-b513-4341-a418-ddf26c9e464e could not be found. Jul 15 20:44:03.386582 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:44:03.389634 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-9e9a685e-6d92-4c05-9786-5fd087161260 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Returning 404 to user: Instance 0b11cb14-b513-4341-a418-ddf26c9e464e could not be found. {{(pid=124432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 20:44:03.391311 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-9e9a685e-6d92-4c05-9786-5fd087161260 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "DELETE /compute/v2.1/servers/0b11cb14-b513-4341-a418-ddf26c9e464e" status: 404 len: 111 microversion: 2.1 time: 0.045233 Jul 15 20:44:03.392113 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 455/905] 10.222.0.66 () {58 vars in 1238 bytes} [Fri Jul 15 20:44:03 2022] DELETE /compute/v2.1/servers/0b11cb14-b513-4341-a418-ddf26c9e464e => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 20:44:03.400557 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-e02bc8d7-f9d9-4dad-8661-be5f647c5171 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:44:03.401359 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-e02bc8d7-f9d9-4dad-8661-be5f647c5171 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 0b11cb14-b513-4341-a418-ddf26c9e464e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:44:03.408912 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e02bc8d7-f9d9-4dad-8661-be5f647c5171 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:44:03.409693 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e02bc8d7-f9d9-4dad-8661-be5f647c5171 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:44:03.410655 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e02bc8d7-f9d9-4dad-8661-be5f647c5171 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:44:03.411092 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e02bc8d7-f9d9-4dad-8661-be5f647c5171 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:44:03.427861 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.wsgi [None req-e02bc8d7-f9d9-4dad-8661-be5f647c5171 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] HTTP exception thrown: Instance 0b11cb14-b513-4341-a418-ddf26c9e464e could not be found. Jul 15 20:44:03.429757 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-e02bc8d7-f9d9-4dad-8661-be5f647c5171 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Request method failure captured: Jul 15 20:44:03.429757 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: request: GET /compute/v2.1/servers/0b11cb14-b513-4341-a418-ddf26c9e464e HTTP/1.1 Jul 15 20:44:03.429757 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Accept: application/json Jul 15 20:44:03.429757 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Accept-Encoding: identity Jul 15 20:44:03.429757 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Connection: close Jul 15 20:44:03.429757 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Content-Length: 0 Jul 15 20:44:03.429757 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Content-Type: application/json Jul 15 20:44:03.429757 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Host: 10.222.0.66 Jul 15 20:44:03.429757 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Openstack-System-Scope: None Jul 15 20:44:03.429757 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: User-Agent: python-urllib3/1.26.9 Jul 15 20:44:03.429757 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Auth-Token: gAAAAABi0dBEFjFrdM-t1qn2GVlnIzLFPzEiMCH376b_bq8y8sAU95pWU5rp8WQ4Pzq9aTBnJ2670jBZzG_1C1hPpW20abHkue1szruQ7QW9zRDMObf8WqD4Ko1amQUqwrnk9woNQQT1EHUnoNbLh_TGl4IWhyGUHaJEpKT3PlNLBZc2iT-X8Mk Jul 15 20:44:03.429757 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Domain-Id: None Jul 15 20:44:03.429757 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Domain-Name: None Jul 15 20:44:03.429757 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Identity-Status: Confirmed Jul 15 20:44:03.429757 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Is-Admin-Project: True Jul 15 20:44:03.429757 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Domain-Id: default Jul 15 20:44:03.429757 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Domain-Name: Default Jul 15 20:44:03.429757 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Id: 9af209f962144de4ae7e3575a3890096 Jul 15 20:44:03.429757 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Name: tempest-AttachVolumeTestJSON-1635157670 Jul 15 20:44:03.429757 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Role: member,reader Jul 15 20:44:03.429757 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Roles: member,reader Jul 15 20:44:03.431975 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9af209f962144de4ae7e3575a3890096"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9af209f962144de4ae7e3575a3890096"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9af209f962144de4ae7e3575a3890096"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9af209f962144de4ae7e3575a3890096"}]}] Jul 15 20:44:03.431975 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant: tempest-AttachVolumeTestJSON-1635157670 Jul 15 20:44:03.431975 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant-Id: 9af209f962144de4ae7e3575a3890096 Jul 15 20:44:03.431975 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1635157670 Jul 15 20:44:03.431975 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User: tempest-AttachVolumeTestJSON-1635157670-project Jul 15 20:44:03.431975 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Domain-Id: default Jul 15 20:44:03.431975 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Domain-Name: Default Jul 15 20:44:03.431975 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Id: 75d12a685d9b419fa3606b5f4d1309fe Jul 15 20:44:03.431975 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Name: tempest-AttachVolumeTestJSON-1635157670-project Jul 15 20:44:03.431975 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: method: > Jul 15 20:44:03.431975 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: exception: Instance 0b11cb14-b513-4341-a418-ddf26c9e464e could not be found. Jul 15 20:44:03.431975 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: action_args: {'id': '0b11cb14-b513-4341-a418-ddf26c9e464e'} Jul 15 20:44:03.432782 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 20:44:03.432782 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:44:03.432782 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 20:44:03.432782 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 20:44:03.432782 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 20:44:03.432782 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 20:44:03.432782 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 20:44:03.432782 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 20:44:03.432782 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 20:44:03.432782 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 20:44:03.432782 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b11cb14-b513-4341-a418-ddf26c9e464e could not be found. Jul 15 20:44:03.432782 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:44:03.432782 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:44:03.432782 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:44:03.432782 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:44:03.432782 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:44:03.432782 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:44:03.432782 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 20:44:03.432782 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 20:44:03.432782 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 20:44:03.433986 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 20:44:03.433986 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 20:44:03.433986 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 20:44:03.433986 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 20:44:03.433986 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 20:44:03.433986 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 20:44:03.433986 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 20:44:03.433986 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b11cb14-b513-4341-a418-ddf26c9e464e could not be found. Jul 15 20:44:03.433986 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:44:03.433986 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:44:03.433986 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:44:03.433986 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:44:03.433986 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:44:03.433986 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:44:03.433986 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 20:44:03.433986 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 20:44:03.433986 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b11cb14-b513-4341-a418-ddf26c9e464e could not be found. Jul 15 20:44:03.433986 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:44:03.436266 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-e02bc8d7-f9d9-4dad-8661-be5f647c5171 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Returning 404 to user: Instance 0b11cb14-b513-4341-a418-ddf26c9e464e could not be found. {{(pid=124430) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 20:44:03.437130 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-e02bc8d7-f9d9-4dad-8661-be5f647c5171 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/0b11cb14-b513-4341-a418-ddf26c9e464e" status: 404 len: 111 microversion: 2.1 time: 0.040670 Jul 15 20:44:03.437678 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 451/906] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:44:03 2022] GET /compute/v2.1/servers/0b11cb14-b513-4341-a418-ddf26c9e464e => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 20:44:04.003015 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-89d5ed8d-a0dd-47ec-b6d3-bce7c10d060e tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:44:04.003588 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-89d5ed8d-a0dd-47ec-b6d3-bce7c10d060e tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 526626a0-8b46-4f4a-9371-4b310ac67640] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:44:04.010054 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-89d5ed8d-a0dd-47ec-b6d3-bce7c10d060e tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:44:04.010508 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-89d5ed8d-a0dd-47ec-b6d3-bce7c10d060e tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:44:04.011273 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-89d5ed8d-a0dd-47ec-b6d3-bce7c10d060e tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:44:04.011710 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-89d5ed8d-a0dd-47ec-b6d3-bce7c10d060e tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:44:04.147508 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-89d5ed8d-a0dd-47ec-b6d3-bce7c10d060e tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:04.156292 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-89d5ed8d-a0dd-47ec-b6d3-bce7c10d060e tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:04.157852 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-89d5ed8d-a0dd-47ec-b6d3-bce7c10d060e tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:04.159009 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-89d5ed8d-a0dd-47ec-b6d3-bce7c10d060e tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640" status: 200 len: 1739 microversion: 2.20 time: 0.159995 Jul 15 20:44:04.159578 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 456/907] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:44:03 2022] GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640 => generated 1739 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:44:04.601474 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-92987441-61b5-4997-be84-d07998894878 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:44:04.601978 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-92987441-61b5-4997-be84-d07998894878 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:44:04.608543 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-92987441-61b5-4997-be84-d07998894878 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:44:04.608988 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-92987441-61b5-4997-be84-d07998894878 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:44:04.609741 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-92987441-61b5-4997-be84-d07998894878 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:44:04.610170 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-92987441-61b5-4997-be84-d07998894878 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:44:04.624169 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.wsgi [None req-92987441-61b5-4997-be84-d07998894878 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] HTTP exception thrown: Instance 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e could not be found. Jul 15 20:44:04.625721 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-92987441-61b5-4997-be84-d07998894878 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Request method failure captured: Jul 15 20:44:04.625721 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: request: DELETE /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e HTTP/1.1 Jul 15 20:44:04.625721 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Accept: application/json Jul 15 20:44:04.625721 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Accept-Encoding: identity Jul 15 20:44:04.625721 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Connection: close Jul 15 20:44:04.625721 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Content-Length: 0 Jul 15 20:44:04.625721 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Content-Type: application/json Jul 15 20:44:04.625721 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Host: 10.222.0.66 Jul 15 20:44:04.625721 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Openstack-System-Scope: None Jul 15 20:44:04.625721 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: User-Agent: python-urllib3/1.26.9 Jul 15 20:44:04.625721 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Auth-Token: gAAAAABi0dBEFjFrdM-t1qn2GVlnIzLFPzEiMCH376b_bq8y8sAU95pWU5rp8WQ4Pzq9aTBnJ2670jBZzG_1C1hPpW20abHkue1szruQ7QW9zRDMObf8WqD4Ko1amQUqwrnk9woNQQT1EHUnoNbLh_TGl4IWhyGUHaJEpKT3PlNLBZc2iT-X8Mk Jul 15 20:44:04.625721 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Domain-Id: None Jul 15 20:44:04.625721 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Domain-Name: None Jul 15 20:44:04.625721 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Identity-Status: Confirmed Jul 15 20:44:04.625721 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Is-Admin-Project: True Jul 15 20:44:04.625721 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Domain-Id: default Jul 15 20:44:04.625721 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Domain-Name: Default Jul 15 20:44:04.625721 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Id: 9af209f962144de4ae7e3575a3890096 Jul 15 20:44:04.625721 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Name: tempest-AttachVolumeTestJSON-1635157670 Jul 15 20:44:04.625721 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Role: member,reader Jul 15 20:44:04.625721 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Roles: member,reader Jul 15 20:44:04.627195 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9af209f962144de4ae7e3575a3890096"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9af209f962144de4ae7e3575a3890096"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9af209f962144de4ae7e3575a3890096"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9af209f962144de4ae7e3575a3890096"}]}] Jul 15 20:44:04.627195 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant: tempest-AttachVolumeTestJSON-1635157670 Jul 15 20:44:04.627195 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant-Id: 9af209f962144de4ae7e3575a3890096 Jul 15 20:44:04.627195 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1635157670 Jul 15 20:44:04.627195 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User: tempest-AttachVolumeTestJSON-1635157670-project Jul 15 20:44:04.627195 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Domain-Id: default Jul 15 20:44:04.627195 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Domain-Name: Default Jul 15 20:44:04.627195 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Id: 75d12a685d9b419fa3606b5f4d1309fe Jul 15 20:44:04.627195 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Name: tempest-AttachVolumeTestJSON-1635157670-project Jul 15 20:44:04.627195 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: method: > Jul 15 20:44:04.627195 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: exception: Instance 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e could not be found. Jul 15 20:44:04.627195 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: action_args: {'id': '5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e'} Jul 15 20:44:04.627959 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 20:44:04.627959 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:44:04.627959 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 20:44:04.627959 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 20:44:04.627959 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 20:44:04.627959 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 20:44:04.627959 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 20:44:04.627959 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 20:44:04.627959 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 20:44:04.627959 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 20:44:04.627959 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e could not be found. Jul 15 20:44:04.627959 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:44:04.627959 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:44:04.627959 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:44:04.627959 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:44:04.627959 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:44:04.627959 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:44:04.627959 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 20:44:04.627959 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 20:44:04.627959 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 20:44:04.629270 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 20:44:04.629270 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 15 20:44:04.629270 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 15 20:44:04.629270 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 15 20:44:04.629270 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 15 20:44:04.629270 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 20:44:04.629270 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 20:44:04.629270 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 20:44:04.629270 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 20:44:04.629270 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e could not be found. Jul 15 20:44:04.629270 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:44:04.629270 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:44:04.629270 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:44:04.629270 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:44:04.629270 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:44:04.629270 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:44:04.629270 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 20:44:04.629270 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 20:44:04.629270 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e could not be found. Jul 15 20:44:04.629270 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:44:04.630536 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-92987441-61b5-4997-be84-d07998894878 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Returning 404 to user: Instance 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e could not be found. {{(pid=124430) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 20:44:04.630536 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-92987441-61b5-4997-be84-d07998894878 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "DELETE /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e" status: 404 len: 111 microversion: 2.1 time: 0.029390 Jul 15 20:44:04.630536 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 452/908] 10.222.0.66 () {58 vars in 1238 bytes} [Fri Jul 15 20:44:04 2022] DELETE /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 20:44:04.635847 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-252b4808-fa47-4564-aa51-d6dfd1564345 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:44:04.636470 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-252b4808-fa47-4564-aa51-d6dfd1564345 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] [instance: 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:44:04.643034 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-252b4808-fa47-4564-aa51-d6dfd1564345 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:44:04.643480 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-252b4808-fa47-4564-aa51-d6dfd1564345 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:44:04.644230 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-252b4808-fa47-4564-aa51-d6dfd1564345 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:44:04.644687 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-252b4808-fa47-4564-aa51-d6dfd1564345 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:44:04.658663 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.wsgi [None req-252b4808-fa47-4564-aa51-d6dfd1564345 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] HTTP exception thrown: Instance 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e could not be found. Jul 15 20:44:04.660328 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-252b4808-fa47-4564-aa51-d6dfd1564345 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Request method failure captured: Jul 15 20:44:04.660328 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: request: GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e HTTP/1.1 Jul 15 20:44:04.660328 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Accept: application/json Jul 15 20:44:04.660328 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Accept-Encoding: identity Jul 15 20:44:04.660328 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Connection: close Jul 15 20:44:04.660328 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Content-Length: 0 Jul 15 20:44:04.660328 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Content-Type: application/json Jul 15 20:44:04.660328 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Host: 10.222.0.66 Jul 15 20:44:04.660328 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Openstack-System-Scope: None Jul 15 20:44:04.660328 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: User-Agent: python-urllib3/1.26.9 Jul 15 20:44:04.660328 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Auth-Token: gAAAAABi0dBEFjFrdM-t1qn2GVlnIzLFPzEiMCH376b_bq8y8sAU95pWU5rp8WQ4Pzq9aTBnJ2670jBZzG_1C1hPpW20abHkue1szruQ7QW9zRDMObf8WqD4Ko1amQUqwrnk9woNQQT1EHUnoNbLh_TGl4IWhyGUHaJEpKT3PlNLBZc2iT-X8Mk Jul 15 20:44:04.660328 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Domain-Id: None Jul 15 20:44:04.660328 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Domain-Name: None Jul 15 20:44:04.660328 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Identity-Status: Confirmed Jul 15 20:44:04.660328 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Is-Admin-Project: True Jul 15 20:44:04.660328 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Domain-Id: default Jul 15 20:44:04.660328 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Domain-Name: Default Jul 15 20:44:04.660328 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Id: 9af209f962144de4ae7e3575a3890096 Jul 15 20:44:04.660328 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Name: tempest-AttachVolumeTestJSON-1635157670 Jul 15 20:44:04.660328 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Role: member,reader Jul 15 20:44:04.660328 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Roles: member,reader Jul 15 20:44:04.661756 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9af209f962144de4ae7e3575a3890096"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9af209f962144de4ae7e3575a3890096"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9af209f962144de4ae7e3575a3890096"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9af209f962144de4ae7e3575a3890096"}]}] Jul 15 20:44:04.661756 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Tenant: tempest-AttachVolumeTestJSON-1635157670 Jul 15 20:44:04.661756 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Tenant-Id: 9af209f962144de4ae7e3575a3890096 Jul 15 20:44:04.661756 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1635157670 Jul 15 20:44:04.661756 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User: tempest-AttachVolumeTestJSON-1635157670-project Jul 15 20:44:04.661756 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Domain-Id: default Jul 15 20:44:04.661756 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Domain-Name: Default Jul 15 20:44:04.661756 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Id: 75d12a685d9b419fa3606b5f4d1309fe Jul 15 20:44:04.661756 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Name: tempest-AttachVolumeTestJSON-1635157670-project Jul 15 20:44:04.661756 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: method: > Jul 15 20:44:04.661756 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: exception: Instance 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e could not be found. Jul 15 20:44:04.661756 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: action_args: {'id': '5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e'} Jul 15 20:44:04.662598 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 20:44:04.662598 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:44:04.662598 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 20:44:04.662598 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 20:44:04.662598 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 20:44:04.662598 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 20:44:04.662598 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 20:44:04.662598 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 20:44:04.662598 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 20:44:04.662598 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 20:44:04.662598 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e could not be found. Jul 15 20:44:04.662598 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:44:04.662598 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:44:04.662598 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:44:04.662598 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:44:04.662598 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:44:04.662598 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:44:04.662598 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 20:44:04.662598 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 20:44:04.662598 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 20:44:04.664051 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 20:44:04.664051 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 20:44:04.664051 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 20:44:04.664051 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 20:44:04.664051 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 20:44:04.664051 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 20:44:04.664051 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 20:44:04.664051 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e could not be found. Jul 15 20:44:04.664051 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:44:04.664051 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:44:04.664051 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:44:04.664051 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:44:04.664051 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:44:04.664051 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:44:04.664051 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 20:44:04.664051 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 20:44:04.664051 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e could not be found. Jul 15 20:44:04.664051 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:44:04.665939 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-252b4808-fa47-4564-aa51-d6dfd1564345 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] Returning 404 to user: Instance 5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e could not be found. {{(pid=124432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 20:44:04.665939 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-252b4808-fa47-4564-aa51-d6dfd1564345 tempest-AttachVolumeTestJSON-1635157670 tempest-AttachVolumeTestJSON-1635157670-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e" status: 404 len: 111 microversion: 2.1 time: 0.030137 Jul 15 20:44:04.665939 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 457/909] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:44:04 2022] GET /compute/v2.1/servers/5cb3c5de-f2bf-4e32-a30e-d8a87705bd0e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 20:44:05.178107 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-be4f6256-8809-49d8-819d-8595270a92b3 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:44:05.178706 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-be4f6256-8809-49d8-819d-8595270a92b3 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 526626a0-8b46-4f4a-9371-4b310ac67640] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:44:05.185066 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-be4f6256-8809-49d8-819d-8595270a92b3 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:44:05.185518 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-be4f6256-8809-49d8-819d-8595270a92b3 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:44:05.186285 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-be4f6256-8809-49d8-819d-8595270a92b3 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:44:05.186764 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-be4f6256-8809-49d8-819d-8595270a92b3 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:44:05.404308 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-be4f6256-8809-49d8-819d-8595270a92b3 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:05.413162 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-be4f6256-8809-49d8-819d-8595270a92b3 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:05.414914 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-be4f6256-8809-49d8-819d-8595270a92b3 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:05.417563 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-be4f6256-8809-49d8-819d-8595270a92b3 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640" status: 200 len: 1721 microversion: 2.20 time: 0.243387 Jul 15 20:44:05.418379 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 453/910] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:44:05 2022] GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640 => generated 1721 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:44:06.436548 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-8655bf67-e4ad-426a-9ee9-15be14fec622 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:44:06.437175 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-8655bf67-e4ad-426a-9ee9-15be14fec622 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 526626a0-8b46-4f4a-9371-4b310ac67640] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:44:06.443919 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8655bf67-e4ad-426a-9ee9-15be14fec622 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:44:06.444681 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8655bf67-e4ad-426a-9ee9-15be14fec622 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:44:06.457570 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8655bf67-e4ad-426a-9ee9-15be14fec622 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:44:06.458363 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8655bf67-e4ad-426a-9ee9-15be14fec622 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:44:06.586132 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [req-ce05196a-cf3b-4d9c-831d-f3d5f1eef2da req-8d8b425f-b55a-4156-aa94-790549866682 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "526626a0-8b46-4f4a-9371-4b310ac67640", "name": "network-vif-unplugged", "status": "completed", "tag": "d578337d-2376-4543-8227-625279e42cf8"}]} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:44:06.599852 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-ce05196a-cf3b-4d9c-831d-f3d5f1eef2da req-8d8b425f-b55a-4156-aa94-790549866682 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:44:06.600653 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-ce05196a-cf3b-4d9c-831d-f3d5f1eef2da req-8d8b425f-b55a-4156-aa94-790549866682 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:44:06.616823 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.compute.server_external_events [req-ce05196a-cf3b-4d9c-831d-f3d5f1eef2da req-8d8b425f-b55a-4156-aa94-790549866682 service nova] Creating event network-vif-unplugged:d578337d-2376-4543-8227-625279e42cf8 for instance 526626a0-8b46-4f4a-9371-4b310ac67640 on hv-cinder-79987 Jul 15 20:44:06.623169 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [req-ce05196a-cf3b-4d9c-831d-f3d5f1eef2da req-8d8b425f-b55a-4156-aa94-790549866682 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040973 Jul 15 20:44:06.624434 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 454/911] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:44:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:44:06.767830 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-8655bf67-e4ad-426a-9ee9-15be14fec622 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:06.788140 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-8655bf67-e4ad-426a-9ee9-15be14fec622 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:06.791413 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-8655bf67-e4ad-426a-9ee9-15be14fec622 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:06.792937 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-8655bf67-e4ad-426a-9ee9-15be14fec622 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640" status: 200 len: 1721 microversion: 2.20 time: 0.360314 Jul 15 20:44:06.793678 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 458/912] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:44:06 2022] GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640 => generated 1721 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 20:44:07.812892 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-0ec8bbb2-e578-4edd-873e-fb476719eac8 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:44:07.813896 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-0ec8bbb2-e578-4edd-873e-fb476719eac8 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 526626a0-8b46-4f4a-9371-4b310ac67640] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:44:07.822900 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-0ec8bbb2-e578-4edd-873e-fb476719eac8 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:44:07.823524 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-0ec8bbb2-e578-4edd-873e-fb476719eac8 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:44:07.824337 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-0ec8bbb2-e578-4edd-873e-fb476719eac8 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:44:07.825045 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-0ec8bbb2-e578-4edd-873e-fb476719eac8 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:44:08.067527 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-0ec8bbb2-e578-4edd-873e-fb476719eac8 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:08.088655 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-0ec8bbb2-e578-4edd-873e-fb476719eac8 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:08.090174 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-0ec8bbb2-e578-4edd-873e-fb476719eac8 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:08.091379 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-0ec8bbb2-e578-4edd-873e-fb476719eac8 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640" status: 200 len: 1664 microversion: 2.20 time: 0.283250 Jul 15 20:44:08.092092 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 455/913] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:44:07 2022] GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640 => generated 1664 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:44:08.111687 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-835befd2-eb8e-4503-8720-ab7facbf598f tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4ff86c27-72eb-49d6-98cc-d6f13de17836"}} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:44:08.114378 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-835befd2-eb8e-4503-8720-ab7facbf598f tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 526626a0-8b46-4f4a-9371-4b310ac67640] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:44:08.122613 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-835befd2-eb8e-4503-8720-ab7facbf598f tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:44:08.123645 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-835befd2-eb8e-4503-8720-ab7facbf598f tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:44:08.125178 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-835befd2-eb8e-4503-8720-ab7facbf598f tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:44:08.126050 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-835befd2-eb8e-4503-8720-ab7facbf598f tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:44:08.487096 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-835befd2-eb8e-4503-8720-ab7facbf598f tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "POST /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.380449 Jul 15 20:44:08.492420 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 459/914] 10.222.0.66 () {62 vars in 1363 bytes} [Fri Jul 15 20:44:08 2022] POST /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640/os-volume_attachments => generated 188 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 20:44:08.608118 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-f46547b7-aa0f-470b-8381-e26ee38faf58 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:44:08.608711 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-f46547b7-aa0f-470b-8381-e26ee38faf58 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 526626a0-8b46-4f4a-9371-4b310ac67640] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:44:08.614615 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-f46547b7-aa0f-470b-8381-e26ee38faf58 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:44:08.615062 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-f46547b7-aa0f-470b-8381-e26ee38faf58 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:44:08.615823 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-f46547b7-aa0f-470b-8381-e26ee38faf58 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:44:08.616260 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-f46547b7-aa0f-470b-8381-e26ee38faf58 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:44:08.712783 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-f46547b7-aa0f-470b-8381-e26ee38faf58 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "POST /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640/action" status: 202 len: 0 microversion: 2.20 time: 0.108141 Jul 15 20:44:08.713846 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 456/915] 10.222.0.66 () {62 vars in 1318 bytes} [Fri Jul 15 20:44:08 2022] POST /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 15 20:44:08.726584 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-5ceb352d-8e58-426c-9007-d8c39e19aa79 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:44:08.727372 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-5ceb352d-8e58-426c-9007-d8c39e19aa79 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 526626a0-8b46-4f4a-9371-4b310ac67640] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:44:08.735733 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5ceb352d-8e58-426c-9007-d8c39e19aa79 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:44:08.736177 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5ceb352d-8e58-426c-9007-d8c39e19aa79 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:44:08.736981 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5ceb352d-8e58-426c-9007-d8c39e19aa79 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:44:08.737415 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5ceb352d-8e58-426c-9007-d8c39e19aa79 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:44:08.900871 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-5ceb352d-8e58-426c-9007-d8c39e19aa79 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:08.909357 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-5ceb352d-8e58-426c-9007-d8c39e19aa79 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:08.911041 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-5ceb352d-8e58-426c-9007-d8c39e19aa79 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:08.912062 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-5ceb352d-8e58-426c-9007-d8c39e19aa79 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640" status: 200 len: 1750 microversion: 2.20 time: 0.192225 Jul 15 20:44:08.912806 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 460/916] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:44:08 2022] GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640 => generated 1750 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:44:09.599370 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-435cf2b1-0508-4904-9573-86319bd73b57 tempest-VolumesNegativeTest-610944305 tempest-VolumesNegativeTest-610944305-project] Action: 'create', calling method: .version_select at 0x7ff51811a670>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2135270788", "metadata": {"Type": "work"}}} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:44:09.625106 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-435cf2b1-0508-4904-9573-86319bd73b57 tempest-VolumesNegativeTest-610944305 tempest-VolumesNegativeTest-610944305-project] Request method failure captured: Jul 15 20:44:09.625106 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 15 20:44:09.625106 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Accept: application/json Jul 15 20:44:09.625106 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Accept-Encoding: identity Jul 15 20:44:09.625106 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Connection: close Jul 15 20:44:09.625106 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Content-Length: 122 Jul 15 20:44:09.625106 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Content-Type: application/json Jul 15 20:44:09.625106 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Host: 10.222.0.66 Jul 15 20:44:09.625106 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Openstack-System-Scope: None Jul 15 20:44:09.625106 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: User-Agent: python-urllib3/1.26.9 Jul 15 20:44:09.625106 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Auth-Token: gAAAAABi0dGZnqQ6TasIKKrpu2kgCjTfMxVKxDe3K09qQ47V4t9IO_U6fEbxLk2D0qnJhX6btGjI6z22H8ONDAiLRpmXtHjChlmzrMRryBMr2RY63VYCv0FfNxu7Zge5mXN0PlmIAOhjBjBpLRVO2-KzjGialUe4sXbRO745pb3typvkDDZXH_A Jul 15 20:44:09.625106 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Domain-Id: None Jul 15 20:44:09.625106 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Domain-Name: None Jul 15 20:44:09.625106 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Identity-Status: Confirmed Jul 15 20:44:09.625106 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Is-Admin-Project: True Jul 15 20:44:09.625106 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Domain-Id: default Jul 15 20:44:09.625106 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Domain-Name: Default Jul 15 20:44:09.625106 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Id: a9a405b5382d4c1ab2827f85286b0a04 Jul 15 20:44:09.625106 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Name: tempest-VolumesNegativeTest-610944305 Jul 15 20:44:09.625106 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Role: member,reader Jul 15 20:44:09.625106 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Roles: member,reader Jul 15 20:44:09.626705 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a9a405b5382d4c1ab2827f85286b0a04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_a9a405b5382d4c1ab2827f85286b0a04"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a9a405b5382d4c1ab2827f85286b0a04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/a9a405b5382d4c1ab2827f85286b0a04"}]}] Jul 15 20:44:09.626705 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant: tempest-VolumesNegativeTest-610944305 Jul 15 20:44:09.626705 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant-Id: a9a405b5382d4c1ab2827f85286b0a04 Jul 15 20:44:09.626705 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant-Name: tempest-VolumesNegativeTest-610944305 Jul 15 20:44:09.626705 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User: tempest-VolumesNegativeTest-610944305-project Jul 15 20:44:09.626705 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Domain-Id: default Jul 15 20:44:09.626705 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Domain-Name: Default Jul 15 20:44:09.626705 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Id: 148143bc6f184e31b88b123dcd74f759 Jul 15 20:44:09.626705 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Name: tempest-VolumesNegativeTest-610944305-project Jul 15 20:44:09.626705 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Jul 15 20:44:09.626705 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2135270788", "metadata": {"Type": "work"}}} Jul 15 20:44:09.626705 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: method: Jul 15 20:44:09.626705 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 15 20:44:09.627666 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-2135270788', 'metadata': {'Type': 'work'}}}} Jul 15 20:44:09.627666 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 20:44:09.627666 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:44:09.627666 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 15 20:44:09.627666 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 15 20:44:09.627666 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 15 20:44:09.627666 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise error Jul 15 20:44:09.627666 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 15 20:44:09.627666 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:44:09.627666 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 15 20:44:09.627666 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 15 20:44:09.627666 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:44:09.627666 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 15 20:44:09.627666 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi '#$%' Jul 15 20:44:09.627666 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:44:09.627666 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:44:09.627666 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:44:09.627666 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:44:09.627666 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:44:09.627666 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:44:09.627666 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 20:44:09.627666 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 20:44:09.630507 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 15 20:44:09.630507 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 15 20:44:09.630507 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 20:44:09.630507 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 20:44:09.630507 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 15 20:44:09.630507 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 15 20:44:09.630507 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 15 20:44:09.630507 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 15 20:44:09.630507 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 15 20:44:09.630507 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 15 20:44:09.630507 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 15 20:44:09.630507 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:44:09.630507 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:44:09.630507 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:44:09.630507 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:44:09.630507 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:44:09.630507 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:44:09.630507 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 15 20:44:09.630507 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 15 20:44:09.632233 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 15 20:44:09.632233 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:44:09.632233 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-435cf2b1-0508-4904-9573-86319bd73b57 tempest-VolumesNegativeTest-610944305 tempest-VolumesNegativeTest-610944305-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124430) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 20:44:09.632233 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-435cf2b1-0508-4904-9573-86319bd73b57 tempest-VolumesNegativeTest-610944305 tempest-VolumesNegativeTest-610944305-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.085500 Jul 15 20:44:09.632233 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 457/917] 10.222.0.66 () {60 vars in 1155 bytes} [Fri Jul 15 20:44:09 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 87 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 15 20:44:09.637603 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-49268531-b856-42ad-8f9d-9e40ba5460c2 tempest-VolumesNegativeTest-610944305 tempest-VolumesNegativeTest-610944305-project] Action: 'create', calling method: .version_select at 0x7ff518053160>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1337647937", "metadata": {"Type": "work"}}} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:44:09.640914 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-49268531-b856-42ad-8f9d-9e40ba5460c2 tempest-VolumesNegativeTest-610944305 tempest-VolumesNegativeTest-610944305-project] Request method failure captured: Jul 15 20:44:09.640914 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 15 20:44:09.640914 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Accept: application/json Jul 15 20:44:09.640914 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Accept-Encoding: identity Jul 15 20:44:09.640914 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Connection: close Jul 15 20:44:09.640914 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Content-Length: 120 Jul 15 20:44:09.640914 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Content-Type: application/json Jul 15 20:44:09.640914 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Host: 10.222.0.66 Jul 15 20:44:09.640914 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Openstack-System-Scope: None Jul 15 20:44:09.640914 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: User-Agent: python-urllib3/1.26.9 Jul 15 20:44:09.640914 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Auth-Token: gAAAAABi0dGZnqQ6TasIKKrpu2kgCjTfMxVKxDe3K09qQ47V4t9IO_U6fEbxLk2D0qnJhX6btGjI6z22H8ONDAiLRpmXtHjChlmzrMRryBMr2RY63VYCv0FfNxu7Zge5mXN0PlmIAOhjBjBpLRVO2-KzjGialUe4sXbRO745pb3typvkDDZXH_A Jul 15 20:44:09.640914 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Domain-Id: None Jul 15 20:44:09.640914 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Domain-Name: None Jul 15 20:44:09.640914 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Identity-Status: Confirmed Jul 15 20:44:09.640914 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Is-Admin-Project: True Jul 15 20:44:09.640914 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Domain-Id: default Jul 15 20:44:09.640914 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Domain-Name: Default Jul 15 20:44:09.640914 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Id: a9a405b5382d4c1ab2827f85286b0a04 Jul 15 20:44:09.640914 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Name: tempest-VolumesNegativeTest-610944305 Jul 15 20:44:09.640914 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Role: member,reader Jul 15 20:44:09.640914 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Roles: member,reader Jul 15 20:44:09.642496 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a9a405b5382d4c1ab2827f85286b0a04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_a9a405b5382d4c1ab2827f85286b0a04"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a9a405b5382d4c1ab2827f85286b0a04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/a9a405b5382d4c1ab2827f85286b0a04"}]}] Jul 15 20:44:09.642496 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Tenant: tempest-VolumesNegativeTest-610944305 Jul 15 20:44:09.642496 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Tenant-Id: a9a405b5382d4c1ab2827f85286b0a04 Jul 15 20:44:09.642496 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Tenant-Name: tempest-VolumesNegativeTest-610944305 Jul 15 20:44:09.642496 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User: tempest-VolumesNegativeTest-610944305-project Jul 15 20:44:09.642496 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Domain-Id: default Jul 15 20:44:09.642496 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Domain-Name: Default Jul 15 20:44:09.642496 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Id: 148143bc6f184e31b88b123dcd74f759 Jul 15 20:44:09.642496 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Name: tempest-VolumesNegativeTest-610944305-project Jul 15 20:44:09.642496 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Jul 15 20:44:09.642496 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1337647937", "metadata": {"Type": "work"}}} Jul 15 20:44:09.642496 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: method: Jul 15 20:44:09.642496 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 15 20:44:09.643548 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1337647937', 'metadata': {'Type': 'work'}}}} Jul 15 20:44:09.643548 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 20:44:09.643548 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:44:09.643548 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 15 20:44:09.643548 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 15 20:44:09.643548 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 15 20:44:09.643548 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise error Jul 15 20:44:09.643548 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 15 20:44:09.643548 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:44:09.643548 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 15 20:44:09.643548 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 15 20:44:09.643548 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:44:09.643548 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 15 20:44:09.643548 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi '0' Jul 15 20:44:09.643548 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:44:09.643548 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:44:09.643548 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:44:09.643548 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:44:09.643548 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:44:09.643548 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:44:09.643548 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 20:44:09.643548 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 20:44:09.646873 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 15 20:44:09.646873 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 15 20:44:09.646873 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 20:44:09.646873 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 20:44:09.646873 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 15 20:44:09.646873 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 15 20:44:09.646873 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 15 20:44:09.646873 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 15 20:44:09.646873 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 15 20:44:09.646873 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 15 20:44:09.646873 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 15 20:44:09.646873 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:44:09.646873 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:44:09.646873 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:44:09.646873 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:44:09.646873 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:44:09.646873 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:44:09.646873 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 15 20:44:09.646873 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 15 20:44:09.649258 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 15 20:44:09.649258 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:44:09.649258 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-49268531-b856-42ad-8f9d-9e40ba5460c2 tempest-VolumesNegativeTest-610944305 tempest-VolumesNegativeTest-610944305-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 20:44:09.649258 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-49268531-b856-42ad-8f9d-9e40ba5460c2 tempest-VolumesNegativeTest-610944305 tempest-VolumesNegativeTest-610944305-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009454 Jul 15 20:44:09.650308 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 461/918] 10.222.0.66 () {60 vars in 1155 bytes} [Fri Jul 15 20:44:09 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 15 20:44:09.655070 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-adb81a6e-5f0d-4c94-b5dc-b6782e2a5a7e tempest-VolumesNegativeTest-610944305 tempest-VolumesNegativeTest-610944305-project] Action: 'create', calling method: .version_select at 0x7ff5182b03a0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-102180379", "metadata": {"Type": "work"}}} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:44:09.657604 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-adb81a6e-5f0d-4c94-b5dc-b6782e2a5a7e tempest-VolumesNegativeTest-610944305 tempest-VolumesNegativeTest-610944305-project] Request method failure captured: Jul 15 20:44:09.657604 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 15 20:44:09.657604 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Accept: application/json Jul 15 20:44:09.657604 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Accept-Encoding: identity Jul 15 20:44:09.657604 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Connection: close Jul 15 20:44:09.657604 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Content-Length: 118 Jul 15 20:44:09.657604 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Content-Type: application/json Jul 15 20:44:09.657604 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Host: 10.222.0.66 Jul 15 20:44:09.657604 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Openstack-System-Scope: None Jul 15 20:44:09.657604 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: User-Agent: python-urllib3/1.26.9 Jul 15 20:44:09.657604 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Auth-Token: gAAAAABi0dGZnqQ6TasIKKrpu2kgCjTfMxVKxDe3K09qQ47V4t9IO_U6fEbxLk2D0qnJhX6btGjI6z22H8ONDAiLRpmXtHjChlmzrMRryBMr2RY63VYCv0FfNxu7Zge5mXN0PlmIAOhjBjBpLRVO2-KzjGialUe4sXbRO745pb3typvkDDZXH_A Jul 15 20:44:09.657604 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Domain-Id: None Jul 15 20:44:09.657604 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Domain-Name: None Jul 15 20:44:09.657604 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Identity-Status: Confirmed Jul 15 20:44:09.657604 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Is-Admin-Project: True Jul 15 20:44:09.657604 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Domain-Id: default Jul 15 20:44:09.657604 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Domain-Name: Default Jul 15 20:44:09.657604 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Id: a9a405b5382d4c1ab2827f85286b0a04 Jul 15 20:44:09.657604 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Name: tempest-VolumesNegativeTest-610944305 Jul 15 20:44:09.657604 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Role: member,reader Jul 15 20:44:09.657604 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Roles: member,reader Jul 15 20:44:09.659184 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a9a405b5382d4c1ab2827f85286b0a04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_a9a405b5382d4c1ab2827f85286b0a04"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a9a405b5382d4c1ab2827f85286b0a04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/a9a405b5382d4c1ab2827f85286b0a04"}]}] Jul 15 20:44:09.659184 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant: tempest-VolumesNegativeTest-610944305 Jul 15 20:44:09.659184 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant-Id: a9a405b5382d4c1ab2827f85286b0a04 Jul 15 20:44:09.659184 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant-Name: tempest-VolumesNegativeTest-610944305 Jul 15 20:44:09.659184 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User: tempest-VolumesNegativeTest-610944305-project Jul 15 20:44:09.659184 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Domain-Id: default Jul 15 20:44:09.659184 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Domain-Name: Default Jul 15 20:44:09.659184 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Id: 148143bc6f184e31b88b123dcd74f759 Jul 15 20:44:09.659184 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Name: tempest-VolumesNegativeTest-610944305-project Jul 15 20:44:09.659184 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Jul 15 20:44:09.659184 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-102180379", "metadata": {"Type": "work"}}} Jul 15 20:44:09.659184 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: method: Jul 15 20:44:09.659184 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 15 20:44:09.659986 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-102180379', 'metadata': {'Type': 'work'}}}} Jul 15 20:44:09.659986 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 20:44:09.659986 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:44:09.659986 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 15 20:44:09.659986 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 15 20:44:09.659986 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 15 20:44:09.659986 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise error Jul 15 20:44:09.659986 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 15 20:44:09.659986 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:44:09.659986 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 15 20:44:09.659986 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 15 20:44:09.659986 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:44:09.659986 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 15 20:44:09.659986 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi '' Jul 15 20:44:09.659986 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:44:09.659986 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:44:09.659986 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:44:09.659986 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:44:09.659986 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:44:09.659986 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:44:09.659986 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 20:44:09.659986 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 20:44:09.662216 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 15 20:44:09.662216 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 15 20:44:09.662216 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 20:44:09.662216 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 20:44:09.662216 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 15 20:44:09.662216 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 15 20:44:09.662216 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 15 20:44:09.662216 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 15 20:44:09.662216 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 15 20:44:09.662216 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 15 20:44:09.662216 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 15 20:44:09.662216 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:44:09.662216 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:44:09.662216 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:44:09.662216 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:44:09.662216 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:44:09.662216 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:44:09.662216 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 15 20:44:09.662216 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 15 20:44:09.663616 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 15 20:44:09.663616 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:44:09.663616 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-adb81a6e-5f0d-4c94-b5dc-b6782e2a5a7e tempest-VolumesNegativeTest-610944305 tempest-VolumesNegativeTest-610944305-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124430) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 20:44:09.663616 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-adb81a6e-5f0d-4c94-b5dc-b6782e2a5a7e tempest-VolumesNegativeTest-610944305 tempest-VolumesNegativeTest-610944305-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010837 Jul 15 20:44:09.663616 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 458/919] 10.222.0.66 () {60 vars in 1155 bytes} [Fri Jul 15 20:44:09 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 15 20:44:09.669838 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-42f7fdc9-5f8e-43b4-8be5-9875a70b34a3 tempest-VolumesNegativeTest-610944305 tempest-VolumesNegativeTest-610944305-project] Calling method '.version_select at 0x7ff5137e4b80>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:44:09.700508 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.wsgi [None req-42f7fdc9-5f8e-43b4-8be5-9875a70b34a3 tempest-VolumesNegativeTest-610944305 tempest-VolumesNegativeTest-610944305-project] HTTP exception thrown: Volume tempest-invalid-831450776 could not be found. Jul 15 20:44:09.702500 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-42f7fdc9-5f8e-43b4-8be5-9875a70b34a3 tempest-VolumesNegativeTest-610944305 tempest-VolumesNegativeTest-610944305-project] Request method failure captured: Jul 15 20:44:09.702500 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-831450776 HTTP/1.1 Jul 15 20:44:09.702500 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Accept: application/json Jul 15 20:44:09.702500 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Accept-Encoding: identity Jul 15 20:44:09.702500 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Connection: close Jul 15 20:44:09.702500 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Content-Length: 0 Jul 15 20:44:09.702500 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Content-Type: application/json Jul 15 20:44:09.702500 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Host: 10.222.0.66 Jul 15 20:44:09.702500 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Openstack-System-Scope: None Jul 15 20:44:09.702500 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: User-Agent: python-urllib3/1.26.9 Jul 15 20:44:09.702500 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Auth-Token: gAAAAABi0dGZnqQ6TasIKKrpu2kgCjTfMxVKxDe3K09qQ47V4t9IO_U6fEbxLk2D0qnJhX6btGjI6z22H8ONDAiLRpmXtHjChlmzrMRryBMr2RY63VYCv0FfNxu7Zge5mXN0PlmIAOhjBjBpLRVO2-KzjGialUe4sXbRO745pb3typvkDDZXH_A Jul 15 20:44:09.702500 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Domain-Id: None Jul 15 20:44:09.702500 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Domain-Name: None Jul 15 20:44:09.702500 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Identity-Status: Confirmed Jul 15 20:44:09.702500 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Is-Admin-Project: True Jul 15 20:44:09.702500 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Domain-Id: default Jul 15 20:44:09.702500 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Domain-Name: Default Jul 15 20:44:09.702500 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Id: a9a405b5382d4c1ab2827f85286b0a04 Jul 15 20:44:09.702500 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Name: tempest-VolumesNegativeTest-610944305 Jul 15 20:44:09.702500 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Role: member,reader Jul 15 20:44:09.702500 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Roles: member,reader Jul 15 20:44:09.703865 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a9a405b5382d4c1ab2827f85286b0a04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_a9a405b5382d4c1ab2827f85286b0a04"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a9a405b5382d4c1ab2827f85286b0a04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/a9a405b5382d4c1ab2827f85286b0a04"}]}] Jul 15 20:44:09.703865 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Tenant: tempest-VolumesNegativeTest-610944305 Jul 15 20:44:09.703865 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Tenant-Id: a9a405b5382d4c1ab2827f85286b0a04 Jul 15 20:44:09.703865 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Tenant-Name: tempest-VolumesNegativeTest-610944305 Jul 15 20:44:09.703865 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User: tempest-VolumesNegativeTest-610944305-project Jul 15 20:44:09.703865 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Domain-Id: default Jul 15 20:44:09.703865 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Domain-Name: Default Jul 15 20:44:09.703865 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Id: 148143bc6f184e31b88b123dcd74f759 Jul 15 20:44:09.703865 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Name: tempest-VolumesNegativeTest-610944305-project Jul 15 20:44:09.703865 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: method: Jul 15 20:44:09.703865 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: exception: Volume tempest-invalid-831450776 could not be found. Jul 15 20:44:09.703865 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: action_args: {'id': 'tempest-invalid-831450776'} Jul 15 20:44:09.703865 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 20:44:09.704814 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:44:09.704814 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 15 20:44:09.704814 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 15 20:44:09.704814 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 15 20:44:09.704814 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 15 20:44:09.704814 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 15 20:44:09.704814 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 15 20:44:09.704814 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 15 20:44:09.704814 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 15 20:44:09.704814 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 15 20:44:09.704814 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 15 20:44:09.704814 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 20:44:09.704814 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 20:44:09.704814 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 20:44:09.704814 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 20:44:09.704814 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-831450776 could not be found. (HTTP 404) (Request-ID: req-749d7eab-caec-424c-b6eb-decc4d816628) Jul 15 20:44:09.704814 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:44:09.704814 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:44:09.704814 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:44:09.706257 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:44:09.706257 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 15 20:44:09.706257 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 15 20:44:09.706257 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 15 20:44:09.706257 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 15 20:44:09.706257 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 15 20:44:09.706257 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 15 20:44:09.706257 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 15 20:44:09.706257 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 15 20:44:09.706257 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 15 20:44:09.706257 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 15 20:44:09.706257 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 15 20:44:09.706257 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 15 20:44:09.706257 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 15 20:44:09.706257 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 15 20:44:09.706257 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 15 20:44:09.706257 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 15 20:44:09.706257 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 15 20:44:09.706257 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 15 20:44:09.707445 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 20:44:09.707445 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 20:44:09.707445 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 20:44:09.707445 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 20:44:09.707445 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-831450776 could not be found. Jul 15 20:44:09.707445 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:44:09.707445 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:44:09.707445 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:44:09.707445 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:44:09.707445 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:44:09.707445 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:44:09.707445 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 20:44:09.707445 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 20:44:09.707445 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 15 20:44:09.707445 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 15 20:44:09.707445 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 20:44:09.707445 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 20:44:09.707445 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 15 20:44:09.707445 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 20:44:09.707445 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-831450776 could not be found. Jul 15 20:44:09.709528 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:44:09.709528 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:44:09.709528 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:44:09.709528 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:44:09.709528 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:44:09.709528 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:44:09.709528 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 20:44:09.709528 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 20:44:09.709528 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-831450776 could not be found. Jul 15 20:44:09.709528 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:44:09.709528 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-42f7fdc9-5f8e-43b4-8be5-9875a70b34a3 tempest-VolumesNegativeTest-610944305 tempest-VolumesNegativeTest-610944305-project] Returning 404 to user: Volume tempest-invalid-831450776 could not be found. {{(pid=124432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 20:44:09.709528 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-42f7fdc9-5f8e-43b4-8be5-9875a70b34a3 tempest-VolumesNegativeTest-610944305 tempest-VolumesNegativeTest-610944305-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/tempest-invalid-831450776" status: 404 len: 98 microversion: 2.1 time: 0.038479 Jul 15 20:44:09.709528 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 462/920] 10.222.0.66 () {58 vars in 1214 bytes} [Fri Jul 15 20:44:09 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-831450776 => generated 98 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 15 20:44:09.716525 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-4471ac66-91b2-4bac-9b3f-e4c18bc0d437 tempest-VolumesNegativeTest-610944305 tempest-VolumesNegativeTest-610944305-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004493 Jul 15 20:44:09.717211 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 459/921] 10.222.0.66 () {58 vars in 1139 bytes} [Fri Jul 15 20:44:09 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 15 20:44:09.728950 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-a3cd3df5-29e3-4ef9-9d14-abf579af99e8 tempest-VolumesNegativeTest-610944305 tempest-VolumesNegativeTest-610944305-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003799 Jul 15 20:44:09.729438 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 463/922] 10.222.0.66 () {58 vars in 1136 bytes} [Fri Jul 15 20:44:09 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 15 20:44:09.739128 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-036250a2-b208-4b24-94d2-4324e672f818 tempest-VolumesNegativeTest-610944305 tempest-VolumesNegativeTest-610944305-project] Calling method '.version_select at 0x7ff51816cca0>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:44:09.768043 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.wsgi [None req-036250a2-b208-4b24-94d2-4324e672f818 tempest-VolumesNegativeTest-610944305 tempest-VolumesNegativeTest-610944305-project] HTTP exception thrown: Volume 5ee129f8-179d-4b3f-8799-6f5be6d1e1d0 could not be found. Jul 15 20:44:09.769902 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-036250a2-b208-4b24-94d2-4324e672f818 tempest-VolumesNegativeTest-610944305 tempest-VolumesNegativeTest-610944305-project] Request method failure captured: Jul 15 20:44:09.769902 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: request: DELETE /compute/v2.1/os-volumes/5ee129f8-179d-4b3f-8799-6f5be6d1e1d0 HTTP/1.1 Jul 15 20:44:09.769902 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Accept: application/json Jul 15 20:44:09.769902 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Accept-Encoding: identity Jul 15 20:44:09.769902 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Connection: close Jul 15 20:44:09.769902 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Content-Length: 0 Jul 15 20:44:09.769902 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Content-Type: application/json Jul 15 20:44:09.769902 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Host: 10.222.0.66 Jul 15 20:44:09.769902 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Openstack-System-Scope: None Jul 15 20:44:09.769902 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: User-Agent: python-urllib3/1.26.9 Jul 15 20:44:09.769902 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Auth-Token: gAAAAABi0dGZnqQ6TasIKKrpu2kgCjTfMxVKxDe3K09qQ47V4t9IO_U6fEbxLk2D0qnJhX6btGjI6z22H8ONDAiLRpmXtHjChlmzrMRryBMr2RY63VYCv0FfNxu7Zge5mXN0PlmIAOhjBjBpLRVO2-KzjGialUe4sXbRO745pb3typvkDDZXH_A Jul 15 20:44:09.769902 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Domain-Id: None Jul 15 20:44:09.769902 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Domain-Name: None Jul 15 20:44:09.769902 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Identity-Status: Confirmed Jul 15 20:44:09.769902 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Is-Admin-Project: True Jul 15 20:44:09.769902 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Domain-Id: default Jul 15 20:44:09.769902 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Domain-Name: Default Jul 15 20:44:09.769902 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Id: a9a405b5382d4c1ab2827f85286b0a04 Jul 15 20:44:09.769902 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Name: tempest-VolumesNegativeTest-610944305 Jul 15 20:44:09.769902 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Role: member,reader Jul 15 20:44:09.769902 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Roles: member,reader Jul 15 20:44:09.771437 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a9a405b5382d4c1ab2827f85286b0a04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_a9a405b5382d4c1ab2827f85286b0a04"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a9a405b5382d4c1ab2827f85286b0a04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/a9a405b5382d4c1ab2827f85286b0a04"}]}] Jul 15 20:44:09.771437 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant: tempest-VolumesNegativeTest-610944305 Jul 15 20:44:09.771437 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant-Id: a9a405b5382d4c1ab2827f85286b0a04 Jul 15 20:44:09.771437 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant-Name: tempest-VolumesNegativeTest-610944305 Jul 15 20:44:09.771437 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User: tempest-VolumesNegativeTest-610944305-project Jul 15 20:44:09.771437 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Domain-Id: default Jul 15 20:44:09.771437 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Domain-Name: Default Jul 15 20:44:09.771437 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Id: 148143bc6f184e31b88b123dcd74f759 Jul 15 20:44:09.771437 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Name: tempest-VolumesNegativeTest-610944305-project Jul 15 20:44:09.771437 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: method: Jul 15 20:44:09.771437 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: exception: Volume 5ee129f8-179d-4b3f-8799-6f5be6d1e1d0 could not be found. Jul 15 20:44:09.771437 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: action_args: {'id': '5ee129f8-179d-4b3f-8799-6f5be6d1e1d0'} Jul 15 20:44:09.771437 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 20:44:09.772571 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:44:09.772571 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 15 20:44:09.772571 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 15 20:44:09.772571 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 15 20:44:09.772571 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 15 20:44:09.772571 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 15 20:44:09.772571 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 15 20:44:09.772571 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 15 20:44:09.772571 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 15 20:44:09.772571 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 15 20:44:09.772571 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 15 20:44:09.772571 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 20:44:09.772571 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 20:44:09.772571 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 20:44:09.772571 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 20:44:09.772571 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5ee129f8-179d-4b3f-8799-6f5be6d1e1d0 could not be found. (HTTP 404) (Request-ID: req-4a77e174-81fc-4ef7-935f-95c9ce8a784d) Jul 15 20:44:09.772571 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:44:09.772571 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:44:09.772571 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:44:09.773969 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:44:09.773969 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 15 20:44:09.773969 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 15 20:44:09.773969 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 15 20:44:09.773969 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 15 20:44:09.773969 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 15 20:44:09.773969 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 15 20:44:09.773969 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 15 20:44:09.773969 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 15 20:44:09.773969 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 15 20:44:09.773969 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 15 20:44:09.773969 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 15 20:44:09.773969 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 15 20:44:09.773969 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 15 20:44:09.773969 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 15 20:44:09.773969 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 15 20:44:09.773969 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 15 20:44:09.773969 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 15 20:44:09.773969 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 15 20:44:09.775667 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 20:44:09.775667 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 20:44:09.775667 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 20:44:09.775667 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 20:44:09.775667 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5ee129f8-179d-4b3f-8799-6f5be6d1e1d0 could not be found. Jul 15 20:44:09.775667 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:44:09.775667 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:44:09.775667 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:44:09.775667 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:44:09.775667 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:44:09.775667 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:44:09.775667 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 20:44:09.775667 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 20:44:09.775667 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 15 20:44:09.775667 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 15 20:44:09.775667 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 20:44:09.775667 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 20:44:09.775667 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 15 20:44:09.775667 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 20:44:09.777000 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5ee129f8-179d-4b3f-8799-6f5be6d1e1d0 could not be found. Jul 15 20:44:09.777000 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:44:09.777000 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:44:09.777000 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:44:09.777000 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:44:09.777000 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:44:09.777000 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:44:09.777000 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 20:44:09.777000 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 20:44:09.777000 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5ee129f8-179d-4b3f-8799-6f5be6d1e1d0 could not be found. Jul 15 20:44:09.777000 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:44:09.777000 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-036250a2-b208-4b24-94d2-4324e672f818 tempest-VolumesNegativeTest-610944305 tempest-VolumesNegativeTest-610944305-project] Returning 404 to user: Volume 5ee129f8-179d-4b3f-8799-6f5be6d1e1d0 could not be found. {{(pid=124430) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 20:44:09.777000 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-036250a2-b208-4b24-94d2-4324e672f818 tempest-VolumesNegativeTest-610944305 tempest-VolumesNegativeTest-610944305-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/5ee129f8-179d-4b3f-8799-6f5be6d1e1d0" status: 404 len: 109 microversion: 2.1 time: 0.036449 Jul 15 20:44:09.777000 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 460/923] 10.222.0.66 () {58 vars in 1247 bytes} [Fri Jul 15 20:44:09 2022] DELETE /compute/v2.1/os-volumes/5ee129f8-179d-4b3f-8799-6f5be6d1e1d0 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 20:44:09.783114 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-197ad712-fb82-4159-ac8c-537076426cb6 tempest-VolumesNegativeTest-610944305 tempest-VolumesNegativeTest-610944305-project] Calling method '.version_select at 0x7ff518053430>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:44:09.813747 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.wsgi [None req-197ad712-fb82-4159-ac8c-537076426cb6 tempest-VolumesNegativeTest-610944305 tempest-VolumesNegativeTest-610944305-project] HTTP exception thrown: Volume ed86422b-f4cb-4104-b021-e5afd270f702 could not be found. Jul 15 20:44:09.815807 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-197ad712-fb82-4159-ac8c-537076426cb6 tempest-VolumesNegativeTest-610944305 tempest-VolumesNegativeTest-610944305-project] Request method failure captured: Jul 15 20:44:09.815807 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: request: GET /compute/v2.1/os-volumes/ed86422b-f4cb-4104-b021-e5afd270f702 HTTP/1.1 Jul 15 20:44:09.815807 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Accept: application/json Jul 15 20:44:09.815807 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Accept-Encoding: identity Jul 15 20:44:09.815807 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Connection: close Jul 15 20:44:09.815807 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Content-Length: 0 Jul 15 20:44:09.815807 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Content-Type: application/json Jul 15 20:44:09.815807 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Host: 10.222.0.66 Jul 15 20:44:09.815807 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Openstack-System-Scope: None Jul 15 20:44:09.815807 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: User-Agent: python-urllib3/1.26.9 Jul 15 20:44:09.815807 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Auth-Token: gAAAAABi0dGZnqQ6TasIKKrpu2kgCjTfMxVKxDe3K09qQ47V4t9IO_U6fEbxLk2D0qnJhX6btGjI6z22H8ONDAiLRpmXtHjChlmzrMRryBMr2RY63VYCv0FfNxu7Zge5mXN0PlmIAOhjBjBpLRVO2-KzjGialUe4sXbRO745pb3typvkDDZXH_A Jul 15 20:44:09.815807 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Domain-Id: None Jul 15 20:44:09.815807 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Domain-Name: None Jul 15 20:44:09.815807 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Identity-Status: Confirmed Jul 15 20:44:09.815807 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Is-Admin-Project: True Jul 15 20:44:09.815807 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Domain-Id: default Jul 15 20:44:09.815807 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Domain-Name: Default Jul 15 20:44:09.815807 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Id: a9a405b5382d4c1ab2827f85286b0a04 Jul 15 20:44:09.815807 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Name: tempest-VolumesNegativeTest-610944305 Jul 15 20:44:09.815807 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Role: member,reader Jul 15 20:44:09.815807 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Roles: member,reader Jul 15 20:44:09.817101 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a9a405b5382d4c1ab2827f85286b0a04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_a9a405b5382d4c1ab2827f85286b0a04"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a9a405b5382d4c1ab2827f85286b0a04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/a9a405b5382d4c1ab2827f85286b0a04"}]}] Jul 15 20:44:09.817101 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Tenant: tempest-VolumesNegativeTest-610944305 Jul 15 20:44:09.817101 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Tenant-Id: a9a405b5382d4c1ab2827f85286b0a04 Jul 15 20:44:09.817101 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Tenant-Name: tempest-VolumesNegativeTest-610944305 Jul 15 20:44:09.817101 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User: tempest-VolumesNegativeTest-610944305-project Jul 15 20:44:09.817101 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Domain-Id: default Jul 15 20:44:09.817101 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Domain-Name: Default Jul 15 20:44:09.817101 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Id: 148143bc6f184e31b88b123dcd74f759 Jul 15 20:44:09.817101 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Name: tempest-VolumesNegativeTest-610944305-project Jul 15 20:44:09.817101 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: method: Jul 15 20:44:09.817101 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: exception: Volume ed86422b-f4cb-4104-b021-e5afd270f702 could not be found. Jul 15 20:44:09.817101 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: action_args: {'id': 'ed86422b-f4cb-4104-b021-e5afd270f702'} Jul 15 20:44:09.817101 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 20:44:09.818235 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:44:09.818235 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 15 20:44:09.818235 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 15 20:44:09.818235 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 15 20:44:09.818235 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 15 20:44:09.818235 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 15 20:44:09.818235 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 15 20:44:09.818235 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 15 20:44:09.818235 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 15 20:44:09.818235 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 15 20:44:09.818235 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 15 20:44:09.818235 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 20:44:09.818235 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 20:44:09.818235 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 20:44:09.818235 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 20:44:09.818235 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ed86422b-f4cb-4104-b021-e5afd270f702 could not be found. (HTTP 404) (Request-ID: req-95e936a1-7312-4c24-8808-a4ebcd1ad2f7) Jul 15 20:44:09.818235 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:44:09.818235 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:44:09.818235 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:44:09.819603 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:44:09.819603 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 15 20:44:09.819603 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 15 20:44:09.819603 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 15 20:44:09.819603 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 15 20:44:09.819603 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 15 20:44:09.819603 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 15 20:44:09.819603 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 15 20:44:09.819603 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 15 20:44:09.819603 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 15 20:44:09.819603 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 15 20:44:09.819603 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 15 20:44:09.819603 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 15 20:44:09.819603 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 15 20:44:09.819603 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 15 20:44:09.819603 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 15 20:44:09.819603 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 15 20:44:09.819603 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 15 20:44:09.819603 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 15 20:44:09.821096 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 20:44:09.821096 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 20:44:09.821096 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 20:44:09.821096 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 20:44:09.821096 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ed86422b-f4cb-4104-b021-e5afd270f702 could not be found. Jul 15 20:44:09.821096 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:44:09.821096 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:44:09.821096 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:44:09.821096 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:44:09.821096 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:44:09.821096 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:44:09.821096 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 20:44:09.821096 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 20:44:09.821096 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 15 20:44:09.821096 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 15 20:44:09.821096 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 20:44:09.821096 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 20:44:09.821096 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 15 20:44:09.821096 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 20:44:09.822778 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ed86422b-f4cb-4104-b021-e5afd270f702 could not be found. Jul 15 20:44:09.822778 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:44:09.822778 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:44:09.822778 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:44:09.822778 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:44:09.822778 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:44:09.822778 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:44:09.822778 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 20:44:09.822778 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 20:44:09.822778 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ed86422b-f4cb-4104-b021-e5afd270f702 could not be found. Jul 15 20:44:09.822778 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:44:09.822778 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-197ad712-fb82-4159-ac8c-537076426cb6 tempest-VolumesNegativeTest-610944305 tempest-VolumesNegativeTest-610944305-project] Returning 404 to user: Volume ed86422b-f4cb-4104-b021-e5afd270f702 could not be found. {{(pid=124432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 20:44:09.822778 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-197ad712-fb82-4159-ac8c-537076426cb6 tempest-VolumesNegativeTest-610944305 tempest-VolumesNegativeTest-610944305-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/ed86422b-f4cb-4104-b021-e5afd270f702" status: 404 len: 109 microversion: 2.1 time: 0.038118 Jul 15 20:44:09.822778 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 464/924] 10.222.0.66 () {58 vars in 1244 bytes} [Fri Jul 15 20:44:09 2022] GET /compute/v2.1/os-volumes/ed86422b-f4cb-4104-b021-e5afd270f702 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 20:44:09.934366 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-235c9177-1a55-48df-bab1-a7ee02489164 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:44:09.937114 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-235c9177-1a55-48df-bab1-a7ee02489164 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 526626a0-8b46-4f4a-9371-4b310ac67640] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:44:09.951482 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-235c9177-1a55-48df-bab1-a7ee02489164 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:44:09.952450 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-235c9177-1a55-48df-bab1-a7ee02489164 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:44:09.953849 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-235c9177-1a55-48df-bab1-a7ee02489164 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:44:09.954457 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-235c9177-1a55-48df-bab1-a7ee02489164 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:44:10.127080 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-235c9177-1a55-48df-bab1-a7ee02489164 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:10.137394 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-235c9177-1a55-48df-bab1-a7ee02489164 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:10.139111 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-235c9177-1a55-48df-bab1-a7ee02489164 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:10.140426 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-235c9177-1a55-48df-bab1-a7ee02489164 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640" status: 200 len: 1750 microversion: 2.20 time: 0.213172 Jul 15 20:44:10.141093 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 461/925] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:44:09 2022] GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640 => generated 1750 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:44:11.160477 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-9bc1cd99-e8ea-4e79-a5f4-6fc852e9b754 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:44:11.161226 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-9bc1cd99-e8ea-4e79-a5f4-6fc852e9b754 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 526626a0-8b46-4f4a-9371-4b310ac67640] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:44:11.163408 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:44:11.169799 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9bc1cd99-e8ea-4e79-a5f4-6fc852e9b754 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:44:11.170498 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9bc1cd99-e8ea-4e79-a5f4-6fc852e9b754 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:44:11.171667 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9bc1cd99-e8ea-4e79-a5f4-6fc852e9b754 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:44:11.172304 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9bc1cd99-e8ea-4e79-a5f4-6fc852e9b754 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:44:11.351806 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-9bc1cd99-e8ea-4e79-a5f4-6fc852e9b754 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:11.363221 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-9bc1cd99-e8ea-4e79-a5f4-6fc852e9b754 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:11.364752 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-9bc1cd99-e8ea-4e79-a5f4-6fc852e9b754 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:11.366224 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-9bc1cd99-e8ea-4e79-a5f4-6fc852e9b754 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640" status: 200 len: 1808 microversion: 2.20 time: 0.210969 Jul 15 20:44:11.367319 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 465/926] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:44:11 2022] GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640 => generated 1808 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 20:44:12.389677 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-ca2b9012-50b5-413a-8eed-dbfade4d21c6 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:44:12.391603 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-ca2b9012-50b5-413a-8eed-dbfade4d21c6 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 526626a0-8b46-4f4a-9371-4b310ac67640] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:44:12.405829 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-ca2b9012-50b5-413a-8eed-dbfade4d21c6 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:44:12.407481 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-ca2b9012-50b5-413a-8eed-dbfade4d21c6 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:44:12.409344 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-ca2b9012-50b5-413a-8eed-dbfade4d21c6 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:44:12.410609 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-ca2b9012-50b5-413a-8eed-dbfade4d21c6 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:44:12.580245 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-ca2b9012-50b5-413a-8eed-dbfade4d21c6 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:12.598047 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-ca2b9012-50b5-413a-8eed-dbfade4d21c6 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:12.603173 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-ca2b9012-50b5-413a-8eed-dbfade4d21c6 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:12.605809 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-ca2b9012-50b5-413a-8eed-dbfade4d21c6 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640" status: 200 len: 1808 microversion: 2.20 time: 0.223581 Jul 15 20:44:12.606388 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 462/927] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:44:12 2022] GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640 => generated 1808 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:44:13.623547 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-9eb47d29-ced5-49ad-917c-f60f2b7f965d tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:44:13.624461 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-9eb47d29-ced5-49ad-917c-f60f2b7f965d tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 526626a0-8b46-4f4a-9371-4b310ac67640] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:44:13.631825 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9eb47d29-ced5-49ad-917c-f60f2b7f965d tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:44:13.632284 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9eb47d29-ced5-49ad-917c-f60f2b7f965d tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:44:13.633221 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9eb47d29-ced5-49ad-917c-f60f2b7f965d tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:44:13.633662 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9eb47d29-ced5-49ad-917c-f60f2b7f965d tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:44:13.788879 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-9eb47d29-ced5-49ad-917c-f60f2b7f965d tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:13.798006 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-9eb47d29-ced5-49ad-917c-f60f2b7f965d tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:13.799816 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-9eb47d29-ced5-49ad-917c-f60f2b7f965d tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:13.801254 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-9eb47d29-ced5-49ad-917c-f60f2b7f965d tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640" status: 200 len: 1808 microversion: 2.20 time: 0.181820 Jul 15 20:44:13.812831 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 466/928] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:44:13 2022] GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640 => generated 1808 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:44:14.819387 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-abc8f8d4-9b1a-4eb0-80a2-6ecf5858c867 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:44:14.820105 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-abc8f8d4-9b1a-4eb0-80a2-6ecf5858c867 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 526626a0-8b46-4f4a-9371-4b310ac67640] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:44:14.827842 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-abc8f8d4-9b1a-4eb0-80a2-6ecf5858c867 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:44:14.828295 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-abc8f8d4-9b1a-4eb0-80a2-6ecf5858c867 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:44:14.829137 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-abc8f8d4-9b1a-4eb0-80a2-6ecf5858c867 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:44:14.829573 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-abc8f8d4-9b1a-4eb0-80a2-6ecf5858c867 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:44:15.044466 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-abc8f8d4-9b1a-4eb0-80a2-6ecf5858c867 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:15.053886 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-abc8f8d4-9b1a-4eb0-80a2-6ecf5858c867 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:15.055805 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-abc8f8d4-9b1a-4eb0-80a2-6ecf5858c867 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:15.059680 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-abc8f8d4-9b1a-4eb0-80a2-6ecf5858c867 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640" status: 200 len: 1808 microversion: 2.20 time: 0.244300 Jul 15 20:44:15.061365 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 463/929] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:44:14 2022] GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640 => generated 1808 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:44:16.081178 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-be777a6a-8981-493b-a540-ef69d6108da3 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:44:16.082470 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-be777a6a-8981-493b-a540-ef69d6108da3 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 526626a0-8b46-4f4a-9371-4b310ac67640] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:44:16.090036 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-be777a6a-8981-493b-a540-ef69d6108da3 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:44:16.090473 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-be777a6a-8981-493b-a540-ef69d6108da3 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:44:16.091230 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-be777a6a-8981-493b-a540-ef69d6108da3 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:44:16.091657 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-be777a6a-8981-493b-a540-ef69d6108da3 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:44:16.106490 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:44:16.234513 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-be777a6a-8981-493b-a540-ef69d6108da3 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:16.245218 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-be777a6a-8981-493b-a540-ef69d6108da3 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:16.246711 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-be777a6a-8981-493b-a540-ef69d6108da3 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:16.247939 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-be777a6a-8981-493b-a540-ef69d6108da3 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640" status: 200 len: 1808 microversion: 2.20 time: 0.171648 Jul 15 20:44:16.248485 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 467/930] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:44:16 2022] GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640 => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:44:17.265918 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-d9befaef-daae-4a39-9246-9cafc93313c6 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:44:17.266510 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-d9befaef-daae-4a39-9246-9cafc93313c6 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 526626a0-8b46-4f4a-9371-4b310ac67640] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:44:17.273036 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d9befaef-daae-4a39-9246-9cafc93313c6 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:44:17.273476 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d9befaef-daae-4a39-9246-9cafc93313c6 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:44:17.275109 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d9befaef-daae-4a39-9246-9cafc93313c6 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:44:17.275554 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d9befaef-daae-4a39-9246-9cafc93313c6 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:44:17.439899 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-d9befaef-daae-4a39-9246-9cafc93313c6 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:17.449478 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-d9befaef-daae-4a39-9246-9cafc93313c6 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:17.451010 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-d9befaef-daae-4a39-9246-9cafc93313c6 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:17.452166 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-d9befaef-daae-4a39-9246-9cafc93313c6 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640" status: 200 len: 1808 microversion: 2.20 time: 0.190124 Jul 15 20:44:17.452756 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 464/931] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:44:17 2022] GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640 => generated 1808 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:44:18.472750 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-a07386cf-cc8e-40b5-8605-8db2da47a1bf tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:44:18.474232 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-a07386cf-cc8e-40b5-8605-8db2da47a1bf tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 526626a0-8b46-4f4a-9371-4b310ac67640] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:44:18.482131 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a07386cf-cc8e-40b5-8605-8db2da47a1bf tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:44:18.482723 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a07386cf-cc8e-40b5-8605-8db2da47a1bf tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:44:18.483494 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a07386cf-cc8e-40b5-8605-8db2da47a1bf tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:44:18.483920 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a07386cf-cc8e-40b5-8605-8db2da47a1bf tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:44:18.624963 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-a07386cf-cc8e-40b5-8605-8db2da47a1bf tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:18.633394 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-a07386cf-cc8e-40b5-8605-8db2da47a1bf tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:18.634893 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-a07386cf-cc8e-40b5-8605-8db2da47a1bf tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:18.636040 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-a07386cf-cc8e-40b5-8605-8db2da47a1bf tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640" status: 200 len: 1808 microversion: 2.20 time: 0.168239 Jul 15 20:44:18.636625 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 468/932] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:44:18 2022] GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:44:19.656303 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-d734e61f-65d6-479c-bcfb-46dcdeb9b395 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:44:19.658134 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-d734e61f-65d6-479c-bcfb-46dcdeb9b395 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 526626a0-8b46-4f4a-9371-4b310ac67640] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:44:19.670803 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_api:SELECT=55,nova_api:DELETE=1 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:44:19.673088 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d734e61f-65d6-479c-bcfb-46dcdeb9b395 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:44:19.673795 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d734e61f-65d6-479c-bcfb-46dcdeb9b395 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:44:19.675401 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d734e61f-65d6-479c-bcfb-46dcdeb9b395 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:44:19.676145 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d734e61f-65d6-479c-bcfb-46dcdeb9b395 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:44:19.848669 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-d734e61f-65d6-479c-bcfb-46dcdeb9b395 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:19.860032 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-d734e61f-65d6-479c-bcfb-46dcdeb9b395 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:19.861680 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-d734e61f-65d6-479c-bcfb-46dcdeb9b395 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:19.862894 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-d734e61f-65d6-479c-bcfb-46dcdeb9b395 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640" status: 200 len: 1808 microversion: 2.20 time: 0.211612 Jul 15 20:44:19.863447 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 465/933] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:44:19 2022] GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640 => generated 1808 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:44:20.901757 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-ade8441d-f025-4c48-9b38-eaa972e6cf3a tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:44:20.903281 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-ade8441d-f025-4c48-9b38-eaa972e6cf3a tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 526626a0-8b46-4f4a-9371-4b310ac67640] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:44:20.912620 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ade8441d-f025-4c48-9b38-eaa972e6cf3a tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:44:20.913402 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ade8441d-f025-4c48-9b38-eaa972e6cf3a tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:44:20.914784 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ade8441d-f025-4c48-9b38-eaa972e6cf3a tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:44:20.915542 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ade8441d-f025-4c48-9b38-eaa972e6cf3a tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:44:21.087991 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-ade8441d-f025-4c48-9b38-eaa972e6cf3a tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:21.097704 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-ade8441d-f025-4c48-9b38-eaa972e6cf3a tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:21.099233 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-ade8441d-f025-4c48-9b38-eaa972e6cf3a tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:21.100386 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-ade8441d-f025-4c48-9b38-eaa972e6cf3a tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640" status: 200 len: 1808 microversion: 2.20 time: 0.204756 Jul 15 20:44:21.101400 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 469/934] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:44:20 2022] GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640 => generated 1808 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:44:22.121763 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-298ea520-e75e-47d7-91d5-ca139f745a9e tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:44:22.122370 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-298ea520-e75e-47d7-91d5-ca139f745a9e tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 526626a0-8b46-4f4a-9371-4b310ac67640] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:44:22.128555 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-298ea520-e75e-47d7-91d5-ca139f745a9e tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:44:22.129005 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-298ea520-e75e-47d7-91d5-ca139f745a9e tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:44:22.129762 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-298ea520-e75e-47d7-91d5-ca139f745a9e tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:44:22.130199 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-298ea520-e75e-47d7-91d5-ca139f745a9e tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:44:22.261244 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-298ea520-e75e-47d7-91d5-ca139f745a9e tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:22.269845 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-298ea520-e75e-47d7-91d5-ca139f745a9e tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:22.271367 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-298ea520-e75e-47d7-91d5-ca139f745a9e tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:22.272613 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-298ea520-e75e-47d7-91d5-ca139f745a9e tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640" status: 200 len: 1808 microversion: 2.20 time: 0.154732 Jul 15 20:44:22.284671 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 466/935] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:44:22 2022] GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:44:23.292052 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-317ce711-971f-4278-ae0d-627bbc2eeb94 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:44:23.293235 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-317ce711-971f-4278-ae0d-627bbc2eeb94 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 526626a0-8b46-4f4a-9371-4b310ac67640] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:44:23.300882 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-317ce711-971f-4278-ae0d-627bbc2eeb94 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:44:23.301562 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-317ce711-971f-4278-ae0d-627bbc2eeb94 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:44:23.302337 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-317ce711-971f-4278-ae0d-627bbc2eeb94 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:44:23.302771 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-317ce711-971f-4278-ae0d-627bbc2eeb94 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:44:23.441483 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-317ce711-971f-4278-ae0d-627bbc2eeb94 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:23.450828 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-317ce711-971f-4278-ae0d-627bbc2eeb94 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:23.452449 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-317ce711-971f-4278-ae0d-627bbc2eeb94 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:23.453699 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-317ce711-971f-4278-ae0d-627bbc2eeb94 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640" status: 200 len: 1808 microversion: 2.20 time: 0.165972 Jul 15 20:44:23.454521 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 470/936] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:44:23 2022] GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:44:24.472005 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-e56ccaaf-7b58-4829-abd1-d9e0d91abdf7 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:44:24.473286 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-e56ccaaf-7b58-4829-abd1-d9e0d91abdf7 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 526626a0-8b46-4f4a-9371-4b310ac67640] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:44:24.479972 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e56ccaaf-7b58-4829-abd1-d9e0d91abdf7 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:44:24.480429 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e56ccaaf-7b58-4829-abd1-d9e0d91abdf7 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:44:24.481941 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e56ccaaf-7b58-4829-abd1-d9e0d91abdf7 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:44:24.482342 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e56ccaaf-7b58-4829-abd1-d9e0d91abdf7 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:44:24.622524 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-e56ccaaf-7b58-4829-abd1-d9e0d91abdf7 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:24.632816 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-e56ccaaf-7b58-4829-abd1-d9e0d91abdf7 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:24.634251 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-e56ccaaf-7b58-4829-abd1-d9e0d91abdf7 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:24.635429 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-e56ccaaf-7b58-4829-abd1-d9e0d91abdf7 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640" status: 200 len: 1808 microversion: 2.20 time: 0.168017 Jul 15 20:44:24.635948 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 467/937] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:44:24 2022] GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:44:25.655562 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-f817a963-05d4-426c-b270-c3270dbb42db tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:44:25.656257 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-f817a963-05d4-426c-b270-c3270dbb42db tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 526626a0-8b46-4f4a-9371-4b310ac67640] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:44:25.663102 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f817a963-05d4-426c-b270-c3270dbb42db tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:44:25.663604 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f817a963-05d4-426c-b270-c3270dbb42db tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:44:25.664374 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f817a963-05d4-426c-b270-c3270dbb42db tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:44:25.665094 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f817a963-05d4-426c-b270-c3270dbb42db tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:44:25.841498 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-f817a963-05d4-426c-b270-c3270dbb42db tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:25.850590 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-f817a963-05d4-426c-b270-c3270dbb42db tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:25.852104 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-f817a963-05d4-426c-b270-c3270dbb42db tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:25.853349 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-f817a963-05d4-426c-b270-c3270dbb42db tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640" status: 200 len: 1808 microversion: 2.20 time: 0.203300 Jul 15 20:44:25.853904 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 471/938] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:44:25 2022] GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640 => generated 1808 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:44:26.873122 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-74aa4c79-822c-4ac4-bdf6-f8f4dcdd2801 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:44:26.874300 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-74aa4c79-822c-4ac4-bdf6-f8f4dcdd2801 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 526626a0-8b46-4f4a-9371-4b310ac67640] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:44:26.880106 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-74aa4c79-822c-4ac4-bdf6-f8f4dcdd2801 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:44:26.880589 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-74aa4c79-822c-4ac4-bdf6-f8f4dcdd2801 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:44:26.881347 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-74aa4c79-822c-4ac4-bdf6-f8f4dcdd2801 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:44:26.881778 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-74aa4c79-822c-4ac4-bdf6-f8f4dcdd2801 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:44:27.018568 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-74aa4c79-822c-4ac4-bdf6-f8f4dcdd2801 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:27.027689 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-74aa4c79-822c-4ac4-bdf6-f8f4dcdd2801 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:27.029258 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-74aa4c79-822c-4ac4-bdf6-f8f4dcdd2801 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:27.031452 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-74aa4c79-822c-4ac4-bdf6-f8f4dcdd2801 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640" status: 200 len: 1808 microversion: 2.20 time: 0.162069 Jul 15 20:44:27.032037 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 468/939] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:44:26 2022] GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:44:28.051487 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-539dc812-0928-4a6b-a18c-5289673b2ecf tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:44:28.052087 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-539dc812-0928-4a6b-a18c-5289673b2ecf tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 526626a0-8b46-4f4a-9371-4b310ac67640] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:44:28.058285 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-539dc812-0928-4a6b-a18c-5289673b2ecf tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:44:28.058892 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-539dc812-0928-4a6b-a18c-5289673b2ecf tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:44:28.059644 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-539dc812-0928-4a6b-a18c-5289673b2ecf tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:44:28.060074 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-539dc812-0928-4a6b-a18c-5289673b2ecf tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:44:28.196121 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-539dc812-0928-4a6b-a18c-5289673b2ecf tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:28.204462 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-539dc812-0928-4a6b-a18c-5289673b2ecf tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:28.205960 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-539dc812-0928-4a6b-a18c-5289673b2ecf tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:28.207107 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-539dc812-0928-4a6b-a18c-5289673b2ecf tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640" status: 200 len: 1808 microversion: 2.20 time: 0.159572 Jul 15 20:44:28.207656 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 472/940] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:44:28 2022] GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:44:29.227285 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-6a4a234a-f6af-4014-aaa3-b7d383736f9a tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:44:29.227825 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-6a4a234a-f6af-4014-aaa3-b7d383736f9a tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 526626a0-8b46-4f4a-9371-4b310ac67640] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:44:29.236033 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-6a4a234a-f6af-4014-aaa3-b7d383736f9a tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:44:29.236514 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-6a4a234a-f6af-4014-aaa3-b7d383736f9a tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:44:29.237315 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-6a4a234a-f6af-4014-aaa3-b7d383736f9a tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:44:29.237740 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-6a4a234a-f6af-4014-aaa3-b7d383736f9a tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:44:29.379743 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-6a4a234a-f6af-4014-aaa3-b7d383736f9a tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:29.388902 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-6a4a234a-f6af-4014-aaa3-b7d383736f9a tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:29.390437 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-6a4a234a-f6af-4014-aaa3-b7d383736f9a tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:29.391592 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-6a4a234a-f6af-4014-aaa3-b7d383736f9a tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640" status: 200 len: 1808 microversion: 2.20 time: 0.168346 Jul 15 20:44:29.392141 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 469/941] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:44:29 2022] GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:44:30.411133 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-1fff8a19-3312-4cc0-8e0f-65766a576239 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:44:30.411755 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-1fff8a19-3312-4cc0-8e0f-65766a576239 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 526626a0-8b46-4f4a-9371-4b310ac67640] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:44:30.418987 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1fff8a19-3312-4cc0-8e0f-65766a576239 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:44:30.419442 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1fff8a19-3312-4cc0-8e0f-65766a576239 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:44:30.420347 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1fff8a19-3312-4cc0-8e0f-65766a576239 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:44:30.420840 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1fff8a19-3312-4cc0-8e0f-65766a576239 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:44:30.575940 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-1fff8a19-3312-4cc0-8e0f-65766a576239 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:30.588983 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-1fff8a19-3312-4cc0-8e0f-65766a576239 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:30.590609 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-1fff8a19-3312-4cc0-8e0f-65766a576239 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:30.592963 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-1fff8a19-3312-4cc0-8e0f-65766a576239 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640" status: 200 len: 1808 microversion: 2.20 time: 0.186130 Jul 15 20:44:30.593819 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 473/942] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:44:30 2022] GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640 => generated 1808 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:44:30.730972 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [req-21e86122-4d5c-4584-84e4-546b8feb5e0c req-aec50103-c11b-4b95-a18a-2a3a98ee40c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "526626a0-8b46-4f4a-9371-4b310ac67640", "name": "network-vif-plugged", "status": "completed", "tag": "d578337d-2376-4543-8227-625279e42cf8"}]} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:44:30.746846 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-21e86122-4d5c-4584-84e4-546b8feb5e0c req-aec50103-c11b-4b95-a18a-2a3a98ee40c4 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:44:30.747295 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-21e86122-4d5c-4584-84e4-546b8feb5e0c req-aec50103-c11b-4b95-a18a-2a3a98ee40c4 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:44:30.766052 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.compute.server_external_events [req-21e86122-4d5c-4584-84e4-546b8feb5e0c req-aec50103-c11b-4b95-a18a-2a3a98ee40c4 service nova] Creating event network-vif-plugged:d578337d-2376-4543-8227-625279e42cf8 for instance 526626a0-8b46-4f4a-9371-4b310ac67640 on hv-cinder-79987 Jul 15 20:44:30.771189 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [req-21e86122-4d5c-4584-84e4-546b8feb5e0c req-aec50103-c11b-4b95-a18a-2a3a98ee40c4 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043860 Jul 15 20:44:30.772126 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 470/943] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:44:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:44:31.613229 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-dab95e41-fd91-4fc1-adc4-a66c23bed3ba tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:44:31.614983 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-dab95e41-fd91-4fc1-adc4-a66c23bed3ba tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 526626a0-8b46-4f4a-9371-4b310ac67640] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:44:31.621913 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-dab95e41-fd91-4fc1-adc4-a66c23bed3ba tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:44:31.623213 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-dab95e41-fd91-4fc1-adc4-a66c23bed3ba tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:44:31.624004 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-dab95e41-fd91-4fc1-adc4-a66c23bed3ba tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:44:31.624459 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-dab95e41-fd91-4fc1-adc4-a66c23bed3ba tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:44:31.859062 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-dab95e41-fd91-4fc1-adc4-a66c23bed3ba tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:31.867976 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-dab95e41-fd91-4fc1-adc4-a66c23bed3ba tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:31.869497 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-dab95e41-fd91-4fc1-adc4-a66c23bed3ba tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:31.870651 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-dab95e41-fd91-4fc1-adc4-a66c23bed3ba tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640" status: 200 len: 1808 microversion: 2.20 time: 0.262302 Jul 15 20:44:31.871234 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 474/944] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:44:31 2022] GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640 => generated 1808 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:44:32.891228 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-189b862c-1245-4f9d-88ca-86cd42409511 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:44:32.892828 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-189b862c-1245-4f9d-88ca-86cd42409511 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 526626a0-8b46-4f4a-9371-4b310ac67640] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:44:32.905511 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-189b862c-1245-4f9d-88ca-86cd42409511 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:44:32.906288 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-189b862c-1245-4f9d-88ca-86cd42409511 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:44:32.907147 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-189b862c-1245-4f9d-88ca-86cd42409511 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:44:32.907700 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-189b862c-1245-4f9d-88ca-86cd42409511 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:44:32.913584 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:44:33.464656 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-189b862c-1245-4f9d-88ca-86cd42409511 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:33.476636 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-189b862c-1245-4f9d-88ca-86cd42409511 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:33.478624 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-189b862c-1245-4f9d-88ca-86cd42409511 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:33.480457 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-189b862c-1245-4f9d-88ca-86cd42409511 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640" status: 200 len: 1808 microversion: 2.20 time: 0.592915 Jul 15 20:44:33.491468 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 471/945] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:44:32 2022] GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640 => generated 1808 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:44:34.500166 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-cb79e127-f9ec-4c28-9832-90634dfd60e5 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:44:34.501361 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-cb79e127-f9ec-4c28-9832-90634dfd60e5 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 526626a0-8b46-4f4a-9371-4b310ac67640] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:44:34.507838 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-cb79e127-f9ec-4c28-9832-90634dfd60e5 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:44:34.508279 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-cb79e127-f9ec-4c28-9832-90634dfd60e5 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:44:34.509289 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-cb79e127-f9ec-4c28-9832-90634dfd60e5 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:44:34.509882 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-cb79e127-f9ec-4c28-9832-90634dfd60e5 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:44:34.696264 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-cb79e127-f9ec-4c28-9832-90634dfd60e5 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:34.706032 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-cb79e127-f9ec-4c28-9832-90634dfd60e5 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:34.707607 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-cb79e127-f9ec-4c28-9832-90634dfd60e5 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:34.708831 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-cb79e127-f9ec-4c28-9832-90634dfd60e5 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640" status: 200 len: 1795 microversion: 2.20 time: 0.214710 Jul 15 20:44:34.709395 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 475/946] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:44:34 2022] GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640 => generated 1795 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:44:40.224691 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-6ca2d3a9-f82d-4372-b1d5-820e008ba515 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Action: 'create', calling method: .version_select at 0x7ff518271ee0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2104996658", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH1WwzMkjLGGSrxEzgaDDDTAWev4kHF8T1VFHsr55CGEhsZkvMfsWNtzFFhXMyQzVmry7kn4ka055CVwWszy5FxXhm4og4RkC+EWUUVrGCdABj9TN2aq6wvxSs2qe0VROg=="}} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:44:40.245807 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.quota [None req-6ca2d3a9-f82d-4372-b1d5-820e008ba515 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Getting quotas for project 6c09076eac534571bd221e2cc5872fc6. Resources: {'key_pairs'} {{(pid=124430) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 20:44:40.251000 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.quota [None req-6ca2d3a9-f82d-4372-b1d5-820e008ba515 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Getting quotas for user ce5f88b90c3b43439d4f3f9b3dc63fff and project 6c09076eac534571bd221e2cc5872fc6. Resources: {'key_pairs'} {{(pid=124430) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 20:44:40.275189 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-6ca2d3a9-f82d-4372-b1d5-820e008ba515 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.321873 Jul 15 20:44:40.275911 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 472/947] 10.222.0.66 () {60 vars in 1158 bytes} [Fri Jul 15 20:44:39 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:44:58.060581 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-f4332e06-f580-4581-ac6d-d23c855650ee tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1829772082", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2104996658", "security_groups": [{"name": "tempest-secgroup-smoke-778498841"}], "block_device_mapping_v2": [{"uuid": "6acfdf69-f7c0-403e-8f46-e8dd425fe18a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "66a9f55c-6da3-47d0-86fe-281ad3b00d29"}]}} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:44:58.068790 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_api:SELECT=21 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:44:58.069578 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell1:SELECT=51 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:44:58.172781 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.network.neutron [None req-f4332e06-f580-4581-ac6d-d23c855650ee tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] validate_networks() for [('66a9f55c-6da3-47d0-86fe-281ad3b00d29', None, None, None, None, None)] {{(pid=124432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 20:44:58.536413 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-f4332e06-f580-4581-ac6d-d23c855650ee tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Flavor limits 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 20:44:58.536844 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-f4332e06-f580-4581-ac6d-d23c855650ee tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Image limits 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 20:44:58.537315 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-f4332e06-f580-4581-ac6d-d23c855650ee tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Flavor pref 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 20:44:58.537722 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-f4332e06-f580-4581-ac6d-d23c855650ee tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Image pref 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 20:44:58.538164 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-f4332e06-f580-4581-ac6d-d23c855650ee tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 20:44:58.547546 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f4332e06-f580-4581-ac6d-d23c855650ee tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:44:58.547990 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f4332e06-f580-4581-ac6d-d23c855650ee tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:44:58.548837 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f4332e06-f580-4581-ac6d-d23c855650ee tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:44:58.549270 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f4332e06-f580-4581-ac6d-d23c855650ee tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:44:58.566623 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-f4332e06-f580-4581-ac6d-d23c855650ee tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Getting quotas for project 6c09076eac534571bd221e2cc5872fc6. Resources: {'instances', 'ram', 'cores'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 20:44:58.570565 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-f4332e06-f580-4581-ac6d-d23c855650ee tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Getting quotas for user ce5f88b90c3b43439d4f3f9b3dc63fff and project 6c09076eac534571bd221e2cc5872fc6. Resources: {'instances', 'ram', 'cores'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 20:44:58.627714 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-f4332e06-f580-4581-ac6d-d23c855650ee tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Going to run 1 instances... {{(pid=124432) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 20:44:58.629896 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-f4332e06-f580-4581-ac6d-d23c855650ee tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] [instance: 2285aca5-babb-4433-9939-b29a56721716] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6acfdf69-f7c0-403e-8f46-e8dd425fe18a',volume_size=None,volume_type=None)] {{(pid=124432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 20:44:58.770366 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-f4332e06-f580-4581-ac6d-d23c855650ee tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.714076 Jul 15 20:44:58.775971 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 476/948] 10.222.0.66 () {60 vars in 1146 bytes} [Fri Jul 15 20:44:58 2022] POST /compute/v2.1/servers => generated 405 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 20:44:58.779044 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_cell1:SELECT=5 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:44:58.780506 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_cell0:SELECT=4 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:44:58.781009 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=1 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:44:58.785073 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-65fef9aa-bec2-4b5e-b954-22bc9fe2ef82 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:44:58.785674 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-65fef9aa-bec2-4b5e-b954-22bc9fe2ef82 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] [instance: 2285aca5-babb-4433-9939-b29a56721716] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:44:58.853049 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-65fef9aa-bec2-4b5e-b954-22bc9fe2ef82 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5f88b90c3b43439d4f3f9b3dc63fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c09076eac534571bd221e2cc5872fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:58.860982 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-65fef9aa-bec2-4b5e-b954-22bc9fe2ef82 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] 10.222.0.66 "GET /compute/v2.1/servers/2285aca5-babb-4433-9939-b29a56721716" status: 200 len: 1095 microversion: 2.1 time: 0.083714 Jul 15 20:44:58.864618 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 473/949] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:44:58 2022] GET /compute/v2.1/servers/2285aca5-babb-4433-9939-b29a56721716 => generated 1095 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:44:59.880768 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-48acba67-5b7e-49ef-a07b-b82caea8e340 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:44:59.885201 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-48acba67-5b7e-49ef-a07b-b82caea8e340 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] [instance: 2285aca5-babb-4433-9939-b29a56721716] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:44:59.895448 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-48acba67-5b7e-49ef-a07b-b82caea8e340 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:44:59.895903 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-48acba67-5b7e-49ef-a07b-b82caea8e340 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:44:59.896717 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-48acba67-5b7e-49ef-a07b-b82caea8e340 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:44:59.897157 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-48acba67-5b7e-49ef-a07b-b82caea8e340 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:44:59.959200 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-48acba67-5b7e-49ef-a07b-b82caea8e340 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5f88b90c3b43439d4f3f9b3dc63fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c09076eac534571bd221e2cc5872fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:44:59.966687 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-48acba67-5b7e-49ef-a07b-b82caea8e340 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] 10.222.0.66 "GET /compute/v2.1/servers/2285aca5-babb-4433-9939-b29a56721716" status: 200 len: 1211 microversion: 2.1 time: 0.092966 Jul 15 20:44:59.967267 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 477/950] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:44:59 2022] GET /compute/v2.1/servers/2285aca5-babb-4433-9939-b29a56721716 => generated 1211 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:45:00.983031 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-d2320cd1-30ef-43e4-bf5a-ce4814edcfe1 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:45:00.983646 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-d2320cd1-30ef-43e4-bf5a-ce4814edcfe1 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] [instance: 2285aca5-babb-4433-9939-b29a56721716] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:45:00.990130 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d2320cd1-30ef-43e4-bf5a-ce4814edcfe1 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:00.990587 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d2320cd1-30ef-43e4-bf5a-ce4814edcfe1 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:00.991363 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d2320cd1-30ef-43e4-bf5a-ce4814edcfe1 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:00.991803 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d2320cd1-30ef-43e4-bf5a-ce4814edcfe1 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:01.143027 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-d2320cd1-30ef-43e4-bf5a-ce4814edcfe1 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5f88b90c3b43439d4f3f9b3dc63fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c09076eac534571bd221e2cc5872fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:45:01.151620 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-d2320cd1-30ef-43e4-bf5a-ce4814edcfe1 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] 10.222.0.66 "GET /compute/v2.1/servers/2285aca5-babb-4433-9939-b29a56721716" status: 200 len: 1266 microversion: 2.1 time: 0.172376 Jul 15 20:45:01.152211 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 474/951] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:45:00 2022] GET /compute/v2.1/servers/2285aca5-babb-4433-9939-b29a56721716 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:45:01.301024 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-fd3932e9-f312-4ca5-86fc-d3b9decbb272 req-9446d54d-90af-48de-9271-4c2618610c43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2285aca5-babb-4433-9939-b29a56721716", "tag": "c91f20dd-0fb2-4ca5-bf0f-2fab8dd705da"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:45:01.312133 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-fd3932e9-f312-4ca5-86fc-d3b9decbb272 req-9446d54d-90af-48de-9271-4c2618610c43 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:01.312627 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-fd3932e9-f312-4ca5-86fc-d3b9decbb272 req-9446d54d-90af-48de-9271-4c2618610c43 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:01.339013 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-fd3932e9-f312-4ca5-86fc-d3b9decbb272 req-9446d54d-90af-48de-9271-4c2618610c43 service nova] Creating event network-changed:c91f20dd-0fb2-4ca5-bf0f-2fab8dd705da for instance 2285aca5-babb-4433-9939-b29a56721716 on hv-cinder-79987 Jul 15 20:45:01.345237 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-fd3932e9-f312-4ca5-86fc-d3b9decbb272 req-9446d54d-90af-48de-9271-4c2618610c43 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048181 Jul 15 20:45:01.345835 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 478/952] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:45:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:45:02.172122 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-1a34e15a-5fb7-4f4f-a482-7994c67d20ad tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:45:02.172743 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-1a34e15a-5fb7-4f4f-a482-7994c67d20ad tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] [instance: 2285aca5-babb-4433-9939-b29a56721716] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:45:02.179350 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-1a34e15a-5fb7-4f4f-a482-7994c67d20ad tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:02.179798 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-1a34e15a-5fb7-4f4f-a482-7994c67d20ad tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:02.180634 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-1a34e15a-5fb7-4f4f-a482-7994c67d20ad tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:02.181068 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-1a34e15a-5fb7-4f4f-a482-7994c67d20ad tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:02.328963 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-1a34e15a-5fb7-4f4f-a482-7994c67d20ad tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5f88b90c3b43439d4f3f9b3dc63fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c09076eac534571bd221e2cc5872fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:45:02.338179 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-1a34e15a-5fb7-4f4f-a482-7994c67d20ad tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] 10.222.0.66 "GET /compute/v2.1/servers/2285aca5-babb-4433-9939-b29a56721716" status: 200 len: 1266 microversion: 2.1 time: 0.170359 Jul 15 20:45:02.338756 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 475/953] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:45:02 2022] GET /compute/v2.1/servers/2285aca5-babb-4433-9939-b29a56721716 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:45:03.357239 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-b09cfc0d-2cd2-4260-b824-381cd78b962d tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:45:03.357970 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-b09cfc0d-2cd2-4260-b824-381cd78b962d tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] [instance: 2285aca5-babb-4433-9939-b29a56721716] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:45:03.364209 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b09cfc0d-2cd2-4260-b824-381cd78b962d tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:03.364686 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b09cfc0d-2cd2-4260-b824-381cd78b962d tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:03.365443 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b09cfc0d-2cd2-4260-b824-381cd78b962d tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:03.365879 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b09cfc0d-2cd2-4260-b824-381cd78b962d tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:03.495552 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-b09cfc0d-2cd2-4260-b824-381cd78b962d tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5f88b90c3b43439d4f3f9b3dc63fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c09076eac534571bd221e2cc5872fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:45:03.503126 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-b09cfc0d-2cd2-4260-b824-381cd78b962d tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] 10.222.0.66 "GET /compute/v2.1/servers/2285aca5-babb-4433-9939-b29a56721716" status: 200 len: 1266 microversion: 2.1 time: 0.151221 Jul 15 20:45:03.503684 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 479/954] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:45:03 2022] GET /compute/v2.1/servers/2285aca5-babb-4433-9939-b29a56721716 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:45:04.520005 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-be29051b-731f-4eaa-b78d-4c780d05b04c tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:45:04.520663 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-be29051b-731f-4eaa-b78d-4c780d05b04c tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] [instance: 2285aca5-babb-4433-9939-b29a56721716] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:45:04.527195 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-be29051b-731f-4eaa-b78d-4c780d05b04c tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:04.527647 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-be29051b-731f-4eaa-b78d-4c780d05b04c tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:04.529435 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-be29051b-731f-4eaa-b78d-4c780d05b04c tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:04.529878 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-be29051b-731f-4eaa-b78d-4c780d05b04c tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:04.667337 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-be29051b-731f-4eaa-b78d-4c780d05b04c tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5f88b90c3b43439d4f3f9b3dc63fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c09076eac534571bd221e2cc5872fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:45:04.674884 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-be29051b-731f-4eaa-b78d-4c780d05b04c tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] 10.222.0.66 "GET /compute/v2.1/servers/2285aca5-babb-4433-9939-b29a56721716" status: 200 len: 1266 microversion: 2.1 time: 0.159059 Jul 15 20:45:04.675441 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 476/955] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:45:04 2022] GET /compute/v2.1/servers/2285aca5-babb-4433-9939-b29a56721716 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:45:05.692295 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-428ca54a-5c6a-470b-807b-f7ddf3022a46 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:45:05.692927 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-428ca54a-5c6a-470b-807b-f7ddf3022a46 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] [instance: 2285aca5-babb-4433-9939-b29a56721716] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:45:05.699453 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-428ca54a-5c6a-470b-807b-f7ddf3022a46 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:05.700217 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-428ca54a-5c6a-470b-807b-f7ddf3022a46 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:05.701223 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-428ca54a-5c6a-470b-807b-f7ddf3022a46 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:05.701664 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-428ca54a-5c6a-470b-807b-f7ddf3022a46 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:05.831768 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-428ca54a-5c6a-470b-807b-f7ddf3022a46 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5f88b90c3b43439d4f3f9b3dc63fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c09076eac534571bd221e2cc5872fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:45:05.839204 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-428ca54a-5c6a-470b-807b-f7ddf3022a46 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] 10.222.0.66 "GET /compute/v2.1/servers/2285aca5-babb-4433-9939-b29a56721716" status: 200 len: 1266 microversion: 2.1 time: 0.150798 Jul 15 20:45:05.839753 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 480/956] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:45:05 2022] GET /compute/v2.1/servers/2285aca5-babb-4433-9939-b29a56721716 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:45:06.857099 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-e3229b10-b2e9-4c9a-8b6b-c38f33b9940a tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:45:06.857680 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-e3229b10-b2e9-4c9a-8b6b-c38f33b9940a tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] [instance: 2285aca5-babb-4433-9939-b29a56721716] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:45:06.864105 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e3229b10-b2e9-4c9a-8b6b-c38f33b9940a tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:06.864584 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e3229b10-b2e9-4c9a-8b6b-c38f33b9940a tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:06.865334 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e3229b10-b2e9-4c9a-8b6b-c38f33b9940a tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:06.865762 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e3229b10-b2e9-4c9a-8b6b-c38f33b9940a tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:07.002732 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-e3229b10-b2e9-4c9a-8b6b-c38f33b9940a tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5f88b90c3b43439d4f3f9b3dc63fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c09076eac534571bd221e2cc5872fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:45:07.010101 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-e3229b10-b2e9-4c9a-8b6b-c38f33b9940a tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] 10.222.0.66 "GET /compute/v2.1/servers/2285aca5-babb-4433-9939-b29a56721716" status: 200 len: 1266 microversion: 2.1 time: 0.157471 Jul 15 20:45:07.010662 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 477/957] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:45:06 2022] GET /compute/v2.1/servers/2285aca5-babb-4433-9939-b29a56721716 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:45:08.027027 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-0929046d-9cad-42e3-8fa0-7fe5566fe915 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:45:08.027636 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-0929046d-9cad-42e3-8fa0-7fe5566fe915 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] [instance: 2285aca5-babb-4433-9939-b29a56721716] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:45:08.034681 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0929046d-9cad-42e3-8fa0-7fe5566fe915 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:08.035134 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0929046d-9cad-42e3-8fa0-7fe5566fe915 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:08.035903 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0929046d-9cad-42e3-8fa0-7fe5566fe915 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:08.036345 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0929046d-9cad-42e3-8fa0-7fe5566fe915 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:08.170322 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-0929046d-9cad-42e3-8fa0-7fe5566fe915 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5f88b90c3b43439d4f3f9b3dc63fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c09076eac534571bd221e2cc5872fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:45:08.177738 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-0929046d-9cad-42e3-8fa0-7fe5566fe915 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] 10.222.0.66 "GET /compute/v2.1/servers/2285aca5-babb-4433-9939-b29a56721716" status: 200 len: 1266 microversion: 2.1 time: 0.154743 Jul 15 20:45:08.178302 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 481/958] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:45:08 2022] GET /compute/v2.1/servers/2285aca5-babb-4433-9939-b29a56721716 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:45:09.194410 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-3a53c2f4-4b63-441a-a9ba-c0ba2e63e6e3 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:45:09.195015 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-3a53c2f4-4b63-441a-a9ba-c0ba2e63e6e3 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] [instance: 2285aca5-babb-4433-9939-b29a56721716] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:45:09.197421 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_cell0:SELECT=2 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:45:09.203036 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-3a53c2f4-4b63-441a-a9ba-c0ba2e63e6e3 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:09.203486 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-3a53c2f4-4b63-441a-a9ba-c0ba2e63e6e3 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:09.204256 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-3a53c2f4-4b63-441a-a9ba-c0ba2e63e6e3 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:09.204716 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-3a53c2f4-4b63-441a-a9ba-c0ba2e63e6e3 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:09.337869 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-3a53c2f4-4b63-441a-a9ba-c0ba2e63e6e3 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5f88b90c3b43439d4f3f9b3dc63fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c09076eac534571bd221e2cc5872fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:45:09.345794 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-3a53c2f4-4b63-441a-a9ba-c0ba2e63e6e3 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] 10.222.0.66 "GET /compute/v2.1/servers/2285aca5-babb-4433-9939-b29a56721716" status: 200 len: 1266 microversion: 2.1 time: 0.155201 Jul 15 20:45:09.346361 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 478/959] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:45:09 2022] GET /compute/v2.1/servers/2285aca5-babb-4433-9939-b29a56721716 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:45:10.363125 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-a598330e-dc35-4b60-afca-01b86ddb145e tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:45:10.363731 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-a598330e-dc35-4b60-afca-01b86ddb145e tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] [instance: 2285aca5-babb-4433-9939-b29a56721716] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:45:10.365737 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell0:SELECT=2 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:45:10.366500 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell0:SELECT=6 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:45:10.373587 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a598330e-dc35-4b60-afca-01b86ddb145e tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:10.374028 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a598330e-dc35-4b60-afca-01b86ddb145e tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:10.374786 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a598330e-dc35-4b60-afca-01b86ddb145e tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:10.375211 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a598330e-dc35-4b60-afca-01b86ddb145e tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:10.511325 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-a598330e-dc35-4b60-afca-01b86ddb145e tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5f88b90c3b43439d4f3f9b3dc63fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c09076eac534571bd221e2cc5872fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:45:10.518819 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-a598330e-dc35-4b60-afca-01b86ddb145e tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] 10.222.0.66 "GET /compute/v2.1/servers/2285aca5-babb-4433-9939-b29a56721716" status: 200 len: 1266 microversion: 2.1 time: 0.159618 Jul 15 20:45:10.519381 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 482/960] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:45:10 2022] GET /compute/v2.1/servers/2285aca5-babb-4433-9939-b29a56721716 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:45:10.953256 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [req-3ce415ba-5c19-4e6d-96df-724000e343c1 req-f3453047-be68-4635-ac80-4c721e2638db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2285aca5-babb-4433-9939-b29a56721716", "name": "network-vif-plugged", "status": "completed", "tag": "c91f20dd-0fb2-4ca5-bf0f-2fab8dd705da"}]} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:45:10.962035 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-3ce415ba-5c19-4e6d-96df-724000e343c1 req-f3453047-be68-4635-ac80-4c721e2638db service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:10.962479 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-3ce415ba-5c19-4e6d-96df-724000e343c1 req-f3453047-be68-4635-ac80-4c721e2638db service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:10.975636 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.compute.server_external_events [req-3ce415ba-5c19-4e6d-96df-724000e343c1 req-f3453047-be68-4635-ac80-4c721e2638db service nova] Creating event network-vif-plugged:c91f20dd-0fb2-4ca5-bf0f-2fab8dd705da for instance 2285aca5-babb-4433-9939-b29a56721716 on hv-cinder-79987 Jul 15 20:45:10.980600 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [req-3ce415ba-5c19-4e6d-96df-724000e343c1 req-f3453047-be68-4635-ac80-4c721e2638db service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031118 Jul 15 20:45:10.982273 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 479/961] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:45:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:45:11.535170 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-c526bca4-46f8-4d04-80c2-e8270ed9266d tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:45:11.535776 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-c526bca4-46f8-4d04-80c2-e8270ed9266d tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] [instance: 2285aca5-babb-4433-9939-b29a56721716] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:45:11.542592 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c526bca4-46f8-4d04-80c2-e8270ed9266d tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:11.543050 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c526bca4-46f8-4d04-80c2-e8270ed9266d tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:11.543792 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c526bca4-46f8-4d04-80c2-e8270ed9266d tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:11.544216 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c526bca4-46f8-4d04-80c2-e8270ed9266d tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:11.671502 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-c526bca4-46f8-4d04-80c2-e8270ed9266d tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5f88b90c3b43439d4f3f9b3dc63fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c09076eac534571bd221e2cc5872fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:45:11.678922 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-c526bca4-46f8-4d04-80c2-e8270ed9266d tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] 10.222.0.66 "GET /compute/v2.1/servers/2285aca5-babb-4433-9939-b29a56721716" status: 200 len: 1266 microversion: 2.1 time: 0.147744 Jul 15 20:45:11.679488 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 483/962] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:45:11 2022] GET /compute/v2.1/servers/2285aca5-babb-4433-9939-b29a56721716 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:45:12.698209 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-ca361b6b-3ec1-4cc9-a676-4ac492a3303b tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:45:12.698907 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-ca361b6b-3ec1-4cc9-a676-4ac492a3303b tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] [instance: 2285aca5-babb-4433-9939-b29a56721716] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:45:12.705640 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-ca361b6b-3ec1-4cc9-a676-4ac492a3303b tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:12.706087 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-ca361b6b-3ec1-4cc9-a676-4ac492a3303b tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:12.706855 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-ca361b6b-3ec1-4cc9-a676-4ac492a3303b tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:12.707288 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-ca361b6b-3ec1-4cc9-a676-4ac492a3303b tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:12.840979 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-ca361b6b-3ec1-4cc9-a676-4ac492a3303b tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5f88b90c3b43439d4f3f9b3dc63fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c09076eac534571bd221e2cc5872fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:45:12.849396 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-ca361b6b-3ec1-4cc9-a676-4ac492a3303b tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] 10.222.0.66 "GET /compute/v2.1/servers/2285aca5-babb-4433-9939-b29a56721716" status: 200 len: 1266 microversion: 2.1 time: 0.155938 Jul 15 20:45:12.850504 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 480/963] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:45:12 2022] GET /compute/v2.1/servers/2285aca5-babb-4433-9939-b29a56721716 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:45:13.867078 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-69458b30-abdd-4111-a30e-6225b67389b6 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:45:13.867613 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-69458b30-abdd-4111-a30e-6225b67389b6 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] [instance: 2285aca5-babb-4433-9939-b29a56721716] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:45:13.874663 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-69458b30-abdd-4111-a30e-6225b67389b6 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:13.875113 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-69458b30-abdd-4111-a30e-6225b67389b6 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:13.875882 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-69458b30-abdd-4111-a30e-6225b67389b6 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:13.876323 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-69458b30-abdd-4111-a30e-6225b67389b6 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:13.961881 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-a01739e0-f742-462c-b89c-bfca29dc82fe tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:45:13.962401 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-a01739e0-f742-462c-b89c-bfca29dc82fe tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 526626a0-8b46-4f4a-9371-4b310ac67640] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:45:13.969633 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-a01739e0-f742-462c-b89c-bfca29dc82fe tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:13.970082 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-a01739e0-f742-462c-b89c-bfca29dc82fe tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:13.970858 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-a01739e0-f742-462c-b89c-bfca29dc82fe tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:13.971293 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-a01739e0-f742-462c-b89c-bfca29dc82fe tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:14.000807 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-a01739e0-f742-462c-b89c-bfca29dc82fe tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640/os-volume_attachments/4ff86c27-72eb-49d6-98cc-d6f13de17836" status: 200 len: 194 microversion: 2.20 time: 0.042906 Jul 15 20:45:14.001612 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 481/964] 10.222.0.66 () {60 vars in 1453 bytes} [Fri Jul 15 20:45:13 2022] GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640/os-volume_attachments/4ff86c27-72eb-49d6-98cc-d6f13de17836 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 15 20:45:14.010644 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-69458b30-abdd-4111-a30e-6225b67389b6 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5f88b90c3b43439d4f3f9b3dc63fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c09076eac534571bd221e2cc5872fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:45:14.018895 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-69458b30-abdd-4111-a30e-6225b67389b6 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] 10.222.0.66 "GET /compute/v2.1/servers/2285aca5-babb-4433-9939-b29a56721716" status: 200 len: 1453 microversion: 2.1 time: 0.155754 Jul 15 20:45:14.019459 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 484/965] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:45:13 2022] GET /compute/v2.1/servers/2285aca5-babb-4433-9939-b29a56721716 => generated 1453 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:45:14.035359 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-dc927673-9029-456c-b4da-79b8369954bf tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:45:14.035975 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-dc927673-9029-456c-b4da-79b8369954bf tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] [instance: 2285aca5-babb-4433-9939-b29a56721716] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:45:14.042122 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-dc927673-9029-456c-b4da-79b8369954bf tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:14.042572 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-dc927673-9029-456c-b4da-79b8369954bf tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:14.043335 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-dc927673-9029-456c-b4da-79b8369954bf tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:14.044065 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-dc927673-9029-456c-b4da-79b8369954bf tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:14.063345 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-7cd36e67-00cb-404c-8b1f-7444e9bbc9dd tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:45:14.063837 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-7cd36e67-00cb-404c-8b1f-7444e9bbc9dd tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 526626a0-8b46-4f4a-9371-4b310ac67640] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:45:14.069934 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7cd36e67-00cb-404c-8b1f-7444e9bbc9dd tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:14.070386 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7cd36e67-00cb-404c-8b1f-7444e9bbc9dd tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:14.071157 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7cd36e67-00cb-404c-8b1f-7444e9bbc9dd tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:14.071595 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7cd36e67-00cb-404c-8b1f-7444e9bbc9dd tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:14.155860 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.objects.instance [None req-7cd36e67-00cb-404c-8b1f-7444e9bbc9dd tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lazy-loading 'services' on Instance uuid 526626a0-8b46-4f4a-9371-4b310ac67640 {{(pid=124432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 20:45:14.180696 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-dc927673-9029-456c-b4da-79b8369954bf tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5f88b90c3b43439d4f3f9b3dc63fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c09076eac534571bd221e2cc5872fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:45:14.189407 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-dc927673-9029-456c-b4da-79b8369954bf tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] 10.222.0.66 "GET /compute/v2.1/servers/2285aca5-babb-4433-9939-b29a56721716" status: 200 len: 1453 microversion: 2.1 time: 0.157718 Jul 15 20:45:14.189966 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 482/966] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:45:14 2022] GET /compute/v2.1/servers/2285aca5-babb-4433-9939-b29a56721716 => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:45:14.229339 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-7cd36e67-00cb-404c-8b1f-7444e9bbc9dd tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "DELETE /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640/os-volume_attachments/4ff86c27-72eb-49d6-98cc-d6f13de17836" status: 202 len: 0 microversion: 2.20 time: 0.169907 Jul 15 20:45:14.230138 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 485/967] 10.222.0.66 () {60 vars in 1456 bytes} [Fri Jul 15 20:45:14 2022] DELETE /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640/os-volume_attachments/4ff86c27-72eb-49d6-98cc-d6f13de17836 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 15 20:45:14.239869 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-05b41785-7e87-4c15-8e83-653535accaad tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:45:14.240832 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-05b41785-7e87-4c15-8e83-653535accaad tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 526626a0-8b46-4f4a-9371-4b310ac67640] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:45:14.248056 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-05b41785-7e87-4c15-8e83-653535accaad tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:14.248715 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-05b41785-7e87-4c15-8e83-653535accaad tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:14.249532 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-05b41785-7e87-4c15-8e83-653535accaad tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:14.249930 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-05b41785-7e87-4c15-8e83-653535accaad tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:14.281916 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-05b41785-7e87-4c15-8e83-653535accaad tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045841 Jul 15 20:45:14.282486 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 483/968] 10.222.0.66 () {60 vars in 1342 bytes} [Fri Jul 15 20:45:14 2022] GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 20:45:15.296447 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-3d83a83c-bf88-47ac-8f8e-8f910b18e31f tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:45:15.297486 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-3d83a83c-bf88-47ac-8f8e-8f910b18e31f tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 526626a0-8b46-4f4a-9371-4b310ac67640] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:45:15.304917 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3d83a83c-bf88-47ac-8f8e-8f910b18e31f tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:15.305427 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3d83a83c-bf88-47ac-8f8e-8f910b18e31f tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:15.306197 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3d83a83c-bf88-47ac-8f8e-8f910b18e31f tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:15.306632 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3d83a83c-bf88-47ac-8f8e-8f910b18e31f tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:15.336505 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-3d83a83c-bf88-47ac-8f8e-8f910b18e31f tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045189 Jul 15 20:45:15.337067 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 486/969] 10.222.0.66 () {60 vars in 1342 bytes} [Fri Jul 15 20:45:15 2022] GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:45:15.396145 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-588ab6f8-4925-47ac-861d-f6affde1da99 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:45:15.396698 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-588ab6f8-4925-47ac-861d-f6affde1da99 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 526626a0-8b46-4f4a-9371-4b310ac67640] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:45:15.403566 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-588ab6f8-4925-47ac-861d-f6affde1da99 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:15.404013 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-588ab6f8-4925-47ac-861d-f6affde1da99 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:15.404793 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-588ab6f8-4925-47ac-861d-f6affde1da99 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:15.405220 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-588ab6f8-4925-47ac-861d-f6affde1da99 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:15.431105 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-588ab6f8-4925-47ac-861d-f6affde1da99 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 526626a0-8b46-4f4a-9371-4b310ac67640] Going to try to terminate instance {{(pid=124430) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 20:45:15.511734 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-588ab6f8-4925-47ac-861d-f6affde1da99 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "DELETE /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640" status: 204 len: 0 microversion: 2.20 time: 0.119063 Jul 15 20:45:15.513062 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 484/970] 10.222.0.66 () {60 vars in 1279 bytes} [Fri Jul 15 20:45:15 2022] DELETE /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 15 20:45:15.522651 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-d9592d1b-6da5-484a-bf14-6bb2885ce090 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:45:15.523267 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-d9592d1b-6da5-484a-bf14-6bb2885ce090 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 526626a0-8b46-4f4a-9371-4b310ac67640] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:45:15.530609 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d9592d1b-6da5-484a-bf14-6bb2885ce090 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:15.531092 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d9592d1b-6da5-484a-bf14-6bb2885ce090 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:15.531875 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d9592d1b-6da5-484a-bf14-6bb2885ce090 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:15.532305 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d9592d1b-6da5-484a-bf14-6bb2885ce090 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:15.766085 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-d9592d1b-6da5-484a-bf14-6bb2885ce090 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:45:15.774305 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-d9592d1b-6da5-484a-bf14-6bb2885ce090 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:45:15.775819 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-d9592d1b-6da5-484a-bf14-6bb2885ce090 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:45:15.777006 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-d9592d1b-6da5-484a-bf14-6bb2885ce090 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640" status: 200 len: 1723 microversion: 2.20 time: 0.259383 Jul 15 20:45:15.777653 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 487/971] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:45:15 2022] GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640 => generated 1723 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:45:16.033512 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [req-cc42f571-074a-4c2c-9325-83029dcfdfd2 req-af49290e-7de6-47a4-8233-53c7e7166069 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2285aca5-babb-4433-9939-b29a56721716", "tag": "c91f20dd-0fb2-4ca5-bf0f-2fab8dd705da"}]} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:45:16.042004 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-cc42f571-074a-4c2c-9325-83029dcfdfd2 req-af49290e-7de6-47a4-8233-53c7e7166069 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:16.042517 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-cc42f571-074a-4c2c-9325-83029dcfdfd2 req-af49290e-7de6-47a4-8233-53c7e7166069 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:16.054680 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.compute.server_external_events [req-cc42f571-074a-4c2c-9325-83029dcfdfd2 req-af49290e-7de6-47a4-8233-53c7e7166069 service nova] Creating event network-changed:c91f20dd-0fb2-4ca5-bf0f-2fab8dd705da for instance 2285aca5-babb-4433-9939-b29a56721716 on hv-cinder-79987 Jul 15 20:45:16.059585 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [req-cc42f571-074a-4c2c-9325-83029dcfdfd2 req-af49290e-7de6-47a4-8233-53c7e7166069 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029951 Jul 15 20:45:16.060176 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 485/972] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:45:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:45:16.796520 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-ac84d9ef-e79a-4352-8b9a-dd413f10b873 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:45:16.797345 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-ac84d9ef-e79a-4352-8b9a-dd413f10b873 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 526626a0-8b46-4f4a-9371-4b310ac67640] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:45:16.804141 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ac84d9ef-e79a-4352-8b9a-dd413f10b873 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:16.804659 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ac84d9ef-e79a-4352-8b9a-dd413f10b873 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:16.805432 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ac84d9ef-e79a-4352-8b9a-dd413f10b873 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:16.805860 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ac84d9ef-e79a-4352-8b9a-dd413f10b873 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:16.949296 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-ac84d9ef-e79a-4352-8b9a-dd413f10b873 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:45:16.958301 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-ac84d9ef-e79a-4352-8b9a-dd413f10b873 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:45:16.960015 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-ac84d9ef-e79a-4352-8b9a-dd413f10b873 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:45:16.961199 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-ac84d9ef-e79a-4352-8b9a-dd413f10b873 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640" status: 200 len: 1723 microversion: 2.20 time: 0.168632 Jul 15 20:45:16.962111 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 488/973] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:45:16 2022] GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:45:17.979797 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-44084ab4-917d-4a19-bd04-c4148b48f6f1 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:45:17.980509 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-44084ab4-917d-4a19-bd04-c4148b48f6f1 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 526626a0-8b46-4f4a-9371-4b310ac67640] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:45:17.988023 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-44084ab4-917d-4a19-bd04-c4148b48f6f1 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:17.988509 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-44084ab4-917d-4a19-bd04-c4148b48f6f1 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:17.989268 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-44084ab4-917d-4a19-bd04-c4148b48f6f1 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:17.989707 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-44084ab4-917d-4a19-bd04-c4148b48f6f1 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:18.054444 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-44084ab4-917d-4a19-bd04-c4148b48f6f1 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:45:18.062504 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-44084ab4-917d-4a19-bd04-c4148b48f6f1 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:45:18.063994 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-44084ab4-917d-4a19-bd04-c4148b48f6f1 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:45:18.065153 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-44084ab4-917d-4a19-bd04-c4148b48f6f1 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640" status: 200 len: 1655 microversion: 2.20 time: 0.089661 Jul 15 20:45:18.065712 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 486/974] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:45:17 2022] GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640 => generated 1655 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:45:18.214939 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-d1ea32a3-a7c4-43b0-a692-311c737f3eb0 req-a168ccf8-b6d4-492c-a1fb-ac52d004854c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "526626a0-8b46-4f4a-9371-4b310ac67640", "name": "network-vif-deleted", "tag": "d578337d-2376-4543-8227-625279e42cf8"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:45:18.235580 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-d1ea32a3-a7c4-43b0-a692-311c737f3eb0 req-a168ccf8-b6d4-492c-a1fb-ac52d004854c service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:18.236027 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-d1ea32a3-a7c4-43b0-a692-311c737f3eb0 req-a168ccf8-b6d4-492c-a1fb-ac52d004854c service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:18.254247 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-d1ea32a3-a7c4-43b0-a692-311c737f3eb0 req-a168ccf8-b6d4-492c-a1fb-ac52d004854c service nova] Creating event network-vif-deleted:d578337d-2376-4543-8227-625279e42cf8 for instance 526626a0-8b46-4f4a-9371-4b310ac67640 on hv-cinder-79987 Jul 15 20:45:18.259193 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-d1ea32a3-a7c4-43b0-a692-311c737f3eb0 req-a168ccf8-b6d4-492c-a1fb-ac52d004854c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048415 Jul 15 20:45:18.260590 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 489/975] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:45:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:45:19.083782 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-906b1576-dd44-4e81-9719-675aaca16989 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:45:19.084297 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-906b1576-dd44-4e81-9719-675aaca16989 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 526626a0-8b46-4f4a-9371-4b310ac67640] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:45:19.091858 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-906b1576-dd44-4e81-9719-675aaca16989 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:19.092318 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-906b1576-dd44-4e81-9719-675aaca16989 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:19.093121 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-906b1576-dd44-4e81-9719-675aaca16989 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:19.093560 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-906b1576-dd44-4e81-9719-675aaca16989 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:19.263869 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.wsgi [None req-906b1576-dd44-4e81-9719-675aaca16989 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] HTTP exception thrown: Instance 526626a0-8b46-4f4a-9371-4b310ac67640 could not be found. Jul 15 20:45:19.265537 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-906b1576-dd44-4e81-9719-675aaca16989 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Request method failure captured: Jul 15 20:45:19.265537 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: request: GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640 HTTP/1.1 Jul 15 20:45:19.265537 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Accept: application/json Jul 15 20:45:19.265537 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Accept-Encoding: identity Jul 15 20:45:19.265537 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Connection: close Jul 15 20:45:19.265537 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Content-Length: 0 Jul 15 20:45:19.265537 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Content-Type: application/json Jul 15 20:45:19.265537 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Host: 10.222.0.66 Jul 15 20:45:19.265537 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Openstack-System-Scope: None Jul 15 20:45:19.265537 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: User-Agent: python-urllib3/1.26.9 Jul 15 20:45:19.265537 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Auth-Token: gAAAAABi0dFH_kVmw3XM2IjdbWBHIk7iAsXHabdarxNv4clC7Z6b_TX2DNTWs6HZczbnRUGIwqWChZTwOuYcLMLRL0a1j1H_SaNHcdSWv83qyG1N6BZb2ZfqDMmHNqn-xC38vSrGK9hibvfMLjHFo_ycldhvWSibqI1pbQytko_qiHZAl_ZlM0Y Jul 15 20:45:19.265537 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Domain-Id: None Jul 15 20:45:19.265537 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Domain-Name: None Jul 15 20:45:19.265537 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Identity-Status: Confirmed Jul 15 20:45:19.265537 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Is-Admin-Project: True Jul 15 20:45:19.265537 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Openstack-Nova-Api-Version: 2.20 Jul 15 20:45:19.265537 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Domain-Id: default Jul 15 20:45:19.265537 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Domain-Name: Default Jul 15 20:45:19.265537 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Id: f852483a41394ef699c09ccee827fa28 Jul 15 20:45:19.265537 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2005081688 Jul 15 20:45:19.265537 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Role: member,reader Jul 15 20:45:19.265537 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Roles: member,reader Jul 15 20:45:19.267351 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f852483a41394ef699c09ccee827fa28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f852483a41394ef699c09ccee827fa28"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f852483a41394ef699c09ccee827fa28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f852483a41394ef699c09ccee827fa28"}]}] Jul 15 20:45:19.267351 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2005081688 Jul 15 20:45:19.267351 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant-Id: f852483a41394ef699c09ccee827fa28 Jul 15 20:45:19.267351 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2005081688 Jul 15 20:45:19.267351 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User: tempest-AttachVolumeShelveTestJSON-2005081688-project Jul 15 20:45:19.267351 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Domain-Id: default Jul 15 20:45:19.267351 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Domain-Name: Default Jul 15 20:45:19.267351 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Id: fbe7070e9384403ca998a996e8dd6b50 Jul 15 20:45:19.267351 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2005081688-project Jul 15 20:45:19.267351 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: method: > Jul 15 20:45:19.267351 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: exception: Instance 526626a0-8b46-4f4a-9371-4b310ac67640 could not be found. Jul 15 20:45:19.267351 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: action_args: {'id': '526626a0-8b46-4f4a-9371-4b310ac67640'} Jul 15 20:45:19.268316 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 20:45:19.268316 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:45:19.268316 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 20:45:19.268316 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 20:45:19.268316 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 20:45:19.268316 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 20:45:19.268316 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 20:45:19.268316 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 20:45:19.268316 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 20:45:19.268316 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 20:45:19.268316 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 526626a0-8b46-4f4a-9371-4b310ac67640 could not be found. Jul 15 20:45:19.268316 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:45:19.268316 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:45:19.268316 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:45:19.268316 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:45:19.268316 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:45:19.268316 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:45:19.268316 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 20:45:19.268316 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 20:45:19.268316 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 20:45:19.270523 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 20:45:19.270523 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 20:45:19.270523 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 20:45:19.270523 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 20:45:19.270523 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 20:45:19.270523 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 20:45:19.270523 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 20:45:19.270523 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 526626a0-8b46-4f4a-9371-4b310ac67640 could not be found. Jul 15 20:45:19.270523 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:45:19.270523 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:45:19.270523 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:45:19.270523 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:45:19.270523 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:45:19.270523 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:45:19.270523 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 20:45:19.270523 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 20:45:19.270523 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 526626a0-8b46-4f4a-9371-4b310ac67640 could not be found. Jul 15 20:45:19.270523 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:45:19.272043 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-906b1576-dd44-4e81-9719-675aaca16989 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Returning 404 to user: Instance 526626a0-8b46-4f4a-9371-4b310ac67640 could not be found. {{(pid=124430) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 20:45:19.272043 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-906b1576-dd44-4e81-9719-675aaca16989 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640" status: 404 len: 111 microversion: 2.20 time: 0.187042 Jul 15 20:45:19.272043 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 487/976] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:45:19 2022] GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640 => generated 111 bytes in 188 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 15 20:45:19.277174 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-a8f95a16-1092-4554-ba2c-52305c860479 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '.version_select at 0x7ff518204af0>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:45:19.296019 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-a8f95a16-1092-4554-ba2c-52305c860479 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1703490576" status: 204 len: 0 microversion: 2.20 time: 0.022998 Jul 15 20:45:19.296633 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 490/977] 10.222.0.66 () {60 vars in 1261 bytes} [Fri Jul 15 20:45:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1703490576 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 15 20:45:20.208991 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-3f7404f4-4989-4c94-97fa-24d1093d53ee tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Action: 'create', calling method: .version_select at 0x7ff51816c700>, body: {"keypair": {"name": "tempest-keypair-433306362", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKYhypToeItX5PcYM7+JR8a4MbV//gWZ0qfH6Qup97+JE2tMlWYaDnyquInrDuQivr9+Xw6oCsawVKLr2m+5gFIXuE8btwC0ZzhlhgO2bffyDtCrx4pI4tuZkkjN4z/XEA=="}} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:45:20.223829 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.quota [None req-3f7404f4-4989-4c94-97fa-24d1093d53ee tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Getting quotas for project f852483a41394ef699c09ccee827fa28. Resources: {'key_pairs'} {{(pid=124430) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 20:45:20.228081 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.quota [None req-3f7404f4-4989-4c94-97fa-24d1093d53ee tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Getting quotas for user fbe7070e9384403ca998a996e8dd6b50 and project f852483a41394ef699c09ccee827fa28. Resources: {'key_pairs'} {{(pid=124430) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 20:45:20.251071 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-3f7404f4-4989-4c94-97fa-24d1093d53ee tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.046039 Jul 15 20:45:20.251652 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 488/978] 10.222.0.66 () {62 vars in 1199 bytes} [Fri Jul 15 20:45:20 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 47 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 15 20:45:20.922933 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-58ab2ce7-0cef-4a50-8604-694fc4e442c3 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:45:20.923570 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-58ab2ce7-0cef-4a50-8604-694fc4e442c3 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] [instance: b02f18ea-fd0b-4edd-97a7-17621ab67c8f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:45:20.936215 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [req-32b93c4e-3618-4286-b8ab-315a6e2bf653 req-f272a63f-4249-47a8-8500-fea0cee8af20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b02f18ea-fd0b-4edd-97a7-17621ab67c8f", "tag": "dc16e8e1-450a-4c4e-9a65-56300299d066"}]} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:45:20.941825 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-58ab2ce7-0cef-4a50-8604-694fc4e442c3 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:20.942912 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-58ab2ce7-0cef-4a50-8604-694fc4e442c3 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:20.944273 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-58ab2ce7-0cef-4a50-8604-694fc4e442c3 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:20.947901 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-32b93c4e-3618-4286-b8ab-315a6e2bf653 req-f272a63f-4249-47a8-8500-fea0cee8af20 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:20.948512 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-58ab2ce7-0cef-4a50-8604-694fc4e442c3 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:20.951644 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-32b93c4e-3618-4286-b8ab-315a6e2bf653 req-f272a63f-4249-47a8-8500-fea0cee8af20 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:20.967883 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.compute.server_external_events [req-32b93c4e-3618-4286-b8ab-315a6e2bf653 req-f272a63f-4249-47a8-8500-fea0cee8af20 service nova] Creating event network-changed:dc16e8e1-450a-4c4e-9a65-56300299d066 for instance b02f18ea-fd0b-4edd-97a7-17621ab67c8f on hv-cinder-79987 Jul 15 20:45:20.973715 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [req-32b93c4e-3618-4286-b8ab-315a6e2bf653 req-f272a63f-4249-47a8-8500-fea0cee8af20 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041665 Jul 15 20:45:20.975324 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 489/979] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:45:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:45:21.009038 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-58ab2ce7-0cef-4a50-8604-694fc4e442c3 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] [instance: b02f18ea-fd0b-4edd-97a7-17621ab67c8f] Going to try to terminate instance {{(pid=124432) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 20:45:21.108503 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-58ab2ce7-0cef-4a50-8604-694fc4e442c3 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] 10.222.0.66 "DELETE /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f" status: 204 len: 0 microversion: 2.1 time: 0.189223 Jul 15 20:45:21.109341 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 491/980] 10.222.0.66 () {58 vars in 1238 bytes} [Fri Jul 15 20:45:20 2022] DELETE /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 20:45:21.117850 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-4c4dfc1b-f196-4a06-aeba-feb99aaf59c3 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:45:21.118769 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-4c4dfc1b-f196-4a06-aeba-feb99aaf59c3 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] [instance: b02f18ea-fd0b-4edd-97a7-17621ab67c8f] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:45:21.131137 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-4c4dfc1b-f196-4a06-aeba-feb99aaf59c3 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:21.131891 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-4c4dfc1b-f196-4a06-aeba-feb99aaf59c3 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:21.133925 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-4c4dfc1b-f196-4a06-aeba-feb99aaf59c3 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:21.134524 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-4c4dfc1b-f196-4a06-aeba-feb99aaf59c3 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:21.357534 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-4c4dfc1b-f196-4a06-aeba-feb99aaf59c3 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e27fccbf854a8b8c9d6d099893f783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e1593c67704dbbafad13310ca35448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:45:21.374686 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-4c4dfc1b-f196-4a06-aeba-feb99aaf59c3 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] 10.222.0.66 "GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f" status: 200 len: 1567 microversion: 2.1 time: 0.260895 Jul 15 20:45:21.376254 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 490/981] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:45:21 2022] GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f => generated 1567 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:45:21.714750 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-8658d144-4a62-422b-9356-8e362828bab9 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1837464287", "imageRef": "a759604a-67e3-4c79-b848-5d03d936d7a0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ceb697eb-c07c-4de1-8715-3ceb0ba4658d"}], "security_groups": [{"name": "tempest-securitygroup--1617155690"}], "key_name": "tempest-keypair-433306362", "user_data": "}} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:45:21.828194 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.network.neutron [None req-8658d144-4a62-422b-9356-8e362828bab9 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] validate_networks() for [('ceb697eb-c07c-4de1-8715-3ceb0ba4658d', None, None, None, None, None)] {{(pid=124432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 20:45:22.207753 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-8658d144-4a62-422b-9356-8e362828bab9 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Flavor limits 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 20:45:22.208339 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-8658d144-4a62-422b-9356-8e362828bab9 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Image limits 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 20:45:22.208672 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-8658d144-4a62-422b-9356-8e362828bab9 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Flavor pref 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 20:45:22.209086 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-8658d144-4a62-422b-9356-8e362828bab9 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Image pref 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 20:45:22.209501 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-8658d144-4a62-422b-9356-8e362828bab9 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 20:45:22.218906 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8658d144-4a62-422b-9356-8e362828bab9 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:22.219294 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8658d144-4a62-422b-9356-8e362828bab9 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:22.220094 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8658d144-4a62-422b-9356-8e362828bab9 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:22.220582 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8658d144-4a62-422b-9356-8e362828bab9 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:22.237698 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-8658d144-4a62-422b-9356-8e362828bab9 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Getting quotas for project f852483a41394ef699c09ccee827fa28. Resources: {'instances', 'ram', 'cores'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 20:45:22.241643 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-8658d144-4a62-422b-9356-8e362828bab9 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Getting quotas for user fbe7070e9384403ca998a996e8dd6b50 and project f852483a41394ef699c09ccee827fa28. Resources: {'instances', 'ram', 'cores'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 20:45:22.252885 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-8658d144-4a62-422b-9356-8e362828bab9 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Going to run 1 instances... {{(pid=124432) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 20:45:22.255371 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-8658d144-4a62-422b-9356-8e362828bab9 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 39e785be-449f-47ab-9327-8b6a91f7d4c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a759604a-67e3-4c79-b848-5d03d936d7a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 20:45:22.304821 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-8658d144-4a62-422b-9356-8e362828bab9 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.594993 Jul 15 20:45:22.305851 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 492/982] 10.222.0.66 () {62 vars in 1187 bytes} [Fri Jul 15 20:45:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 15 20:45:22.315983 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-509888de-17f4-4b35-9fa4-5904f92f36fa tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:45:22.316639 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-509888de-17f4-4b35-9fa4-5904f92f36fa tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 39e785be-449f-47ab-9327-8b6a91f7d4c3] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:45:22.395500 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-509888de-17f4-4b35-9fa4-5904f92f36fa tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:45:22.397007 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-6c9ef07f-2bd2-4a60-be45-9a9682c4ca20 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:45:22.398102 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-6c9ef07f-2bd2-4a60-be45-9a9682c4ca20 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] [instance: b02f18ea-fd0b-4edd-97a7-17621ab67c8f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:45:22.404970 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-509888de-17f4-4b35-9fa4-5904f92f36fa tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:45:22.406705 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-509888de-17f4-4b35-9fa4-5904f92f36fa tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:45:22.407245 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6c9ef07f-2bd2-4a60-be45-9a9682c4ca20 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:22.407757 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6c9ef07f-2bd2-4a60-be45-9a9682c4ca20 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:22.408644 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6c9ef07f-2bd2-4a60-be45-9a9682c4ca20 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:22.409023 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-509888de-17f4-4b35-9fa4-5904f92f36fa tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3" status: 200 len: 1281 microversion: 2.20 time: 0.096920 Jul 15 20:45:22.409159 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6c9ef07f-2bd2-4a60-be45-9a9682c4ca20 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:22.412752 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 491/983] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:45:22 2022] GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3 => generated 1281 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 20:45:22.565822 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-6c9ef07f-2bd2-4a60-be45-9a9682c4ca20 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e27fccbf854a8b8c9d6d099893f783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e1593c67704dbbafad13310ca35448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:45:22.569453 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:45:22.574502 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-6c9ef07f-2bd2-4a60-be45-9a9682c4ca20 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] 10.222.0.66 "GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f" status: 200 len: 1567 microversion: 2.1 time: 0.183730 Jul 15 20:45:22.575789 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 493/984] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:45:22 2022] GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f => generated 1567 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:45:23.283684 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [req-96260a61-2c1a-4f4a-868f-2887b9d74684 req-a1bada52-404b-4cb3-9bad-324af9f91d8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b02f18ea-fd0b-4edd-97a7-17621ab67c8f", "name": "network-vif-deleted", "tag": "dc16e8e1-450a-4c4e-9a65-56300299d066"}]} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:45:23.295777 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-96260a61-2c1a-4f4a-868f-2887b9d74684 req-a1bada52-404b-4cb3-9bad-324af9f91d8a service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:23.296491 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-96260a61-2c1a-4f4a-868f-2887b9d74684 req-a1bada52-404b-4cb3-9bad-324af9f91d8a service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:23.311536 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.compute.server_external_events [req-96260a61-2c1a-4f4a-868f-2887b9d74684 req-a1bada52-404b-4cb3-9bad-324af9f91d8a service nova] Creating event network-vif-deleted:dc16e8e1-450a-4c4e-9a65-56300299d066 for instance b02f18ea-fd0b-4edd-97a7-17621ab67c8f on hv-cinder-79987 Jul 15 20:45:23.317440 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [req-96260a61-2c1a-4f4a-868f-2887b9d74684 req-a1bada52-404b-4cb3-9bad-324af9f91d8a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037162 Jul 15 20:45:23.318381 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 492/985] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:45:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:45:23.427742 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-ee559033-0859-4d4f-b1d4-90d03cbed5f4 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:45:23.428630 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-ee559033-0859-4d4f-b1d4-90d03cbed5f4 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 39e785be-449f-47ab-9327-8b6a91f7d4c3] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:45:23.436980 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ee559033-0859-4d4f-b1d4-90d03cbed5f4 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:23.437477 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ee559033-0859-4d4f-b1d4-90d03cbed5f4 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:23.438318 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ee559033-0859-4d4f-b1d4-90d03cbed5f4 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:23.438759 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ee559033-0859-4d4f-b1d4-90d03cbed5f4 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:23.515940 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-ee559033-0859-4d4f-b1d4-90d03cbed5f4 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:45:23.524736 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-ee559033-0859-4d4f-b1d4-90d03cbed5f4 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:45:23.526246 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-ee559033-0859-4d4f-b1d4-90d03cbed5f4 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:45:23.527341 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-ee559033-0859-4d4f-b1d4-90d03cbed5f4 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3" status: 200 len: 1351 microversion: 2.20 time: 0.104203 Jul 15 20:45:23.528456 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 494/986] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:45:23 2022] GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3 => generated 1351 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:45:23.594454 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-8665e9b5-d6bb-4b1d-9c37-a2cc779024a4 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:45:23.595043 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-8665e9b5-d6bb-4b1d-9c37-a2cc779024a4 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] [instance: b02f18ea-fd0b-4edd-97a7-17621ab67c8f] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:45:23.602123 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8665e9b5-d6bb-4b1d-9c37-a2cc779024a4 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:23.602572 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8665e9b5-d6bb-4b1d-9c37-a2cc779024a4 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:23.604272 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8665e9b5-d6bb-4b1d-9c37-a2cc779024a4 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:23.604745 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-8665e9b5-d6bb-4b1d-9c37-a2cc779024a4 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:23.958805 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-8665e9b5-d6bb-4b1d-9c37-a2cc779024a4 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e27fccbf854a8b8c9d6d099893f783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e1593c67704dbbafad13310ca35448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:45:23.967475 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-8665e9b5-d6bb-4b1d-9c37-a2cc779024a4 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] 10.222.0.66 "GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f" status: 200 len: 1218 microversion: 2.1 time: 0.378639 Jul 15 20:45:23.968150 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 493/987] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:45:23 2022] GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f => generated 1218 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:45:24.546268 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-f05b4905-3b2c-4b1b-b1de-ef1c18fa96f6 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:45:24.546879 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-f05b4905-3b2c-4b1b-b1de-ef1c18fa96f6 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 39e785be-449f-47ab-9327-8b6a91f7d4c3] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:45:24.553721 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f05b4905-3b2c-4b1b-b1de-ef1c18fa96f6 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:24.554172 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f05b4905-3b2c-4b1b-b1de-ef1c18fa96f6 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:24.554942 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f05b4905-3b2c-4b1b-b1de-ef1c18fa96f6 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:24.555518 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f05b4905-3b2c-4b1b-b1de-ef1c18fa96f6 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:24.702427 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-f05b4905-3b2c-4b1b-b1de-ef1c18fa96f6 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:45:24.711269 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-f05b4905-3b2c-4b1b-b1de-ef1c18fa96f6 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:45:24.712749 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-f05b4905-3b2c-4b1b-b1de-ef1c18fa96f6 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:45:24.714259 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-f05b4905-3b2c-4b1b-b1de-ef1c18fa96f6 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3" status: 200 len: 1407 microversion: 2.20 time: 0.171873 Jul 15 20:45:24.715137 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 495/988] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:45:24 2022] GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3 => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:45:24.985735 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-93c579db-104d-49fa-bf82-6adb61aee33e tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:45:24.986575 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-93c579db-104d-49fa-bf82-6adb61aee33e tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] [instance: b02f18ea-fd0b-4edd-97a7-17621ab67c8f] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:45:24.993490 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-93c579db-104d-49fa-bf82-6adb61aee33e tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:24.994022 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-93c579db-104d-49fa-bf82-6adb61aee33e tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:24.995036 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-93c579db-104d-49fa-bf82-6adb61aee33e tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:24.995570 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-93c579db-104d-49fa-bf82-6adb61aee33e tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:25.001529 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:45:25.013673 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.wsgi [None req-93c579db-104d-49fa-bf82-6adb61aee33e tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] HTTP exception thrown: Instance b02f18ea-fd0b-4edd-97a7-17621ab67c8f could not be found. Jul 15 20:45:25.015443 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-93c579db-104d-49fa-bf82-6adb61aee33e tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Request method failure captured: Jul 15 20:45:25.015443 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: request: GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f HTTP/1.1 Jul 15 20:45:25.015443 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Accept: application/json Jul 15 20:45:25.015443 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Accept-Encoding: identity Jul 15 20:45:25.015443 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Connection: close Jul 15 20:45:25.015443 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Content-Length: 0 Jul 15 20:45:25.015443 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Content-Type: application/json Jul 15 20:45:25.015443 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Host: 10.222.0.66 Jul 15 20:45:25.015443 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Openstack-System-Scope: None Jul 15 20:45:25.015443 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: User-Agent: python-urllib3/1.26.9 Jul 15 20:45:25.015443 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Auth-Token: gAAAAABi0dCnvwNTixjh5kB2ifsQXRgpGCxtcBmZbxXMtEaxWOdXgxt97a6-YxDG3lzoKATmv0Pn6v4D3vYAqjUrt4E3guIpRnMYG3VmJojfJu5QLCqrXRTey03bYUIVValKNy0tswBQ88my_drwDtbtng59kht8_zzWZD6sx_PQPVQql19ejyw Jul 15 20:45:25.015443 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Domain-Id: None Jul 15 20:45:25.015443 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Domain-Name: None Jul 15 20:45:25.015443 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Identity-Status: Confirmed Jul 15 20:45:25.015443 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Is-Admin-Project: True Jul 15 20:45:25.015443 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Domain-Id: default Jul 15 20:45:25.015443 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Domain-Name: Default Jul 15 20:45:25.015443 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Id: 13e1593c67704dbbafad13310ca35448 Jul 15 20:45:25.015443 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Name: tempest-TestShelveInstance-218821051 Jul 15 20:45:25.015443 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Role: member,reader Jul 15 20:45:25.015443 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Roles: member,reader Jul 15 20:45:25.017196 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/13e1593c67704dbbafad13310ca35448"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_13e1593c67704dbbafad13310ca35448"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/13e1593c67704dbbafad13310ca35448"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/13e1593c67704dbbafad13310ca35448"}]}] Jul 15 20:45:25.017196 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant: tempest-TestShelveInstance-218821051 Jul 15 20:45:25.017196 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant-Id: 13e1593c67704dbbafad13310ca35448 Jul 15 20:45:25.017196 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant-Name: tempest-TestShelveInstance-218821051 Jul 15 20:45:25.017196 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User: tempest-TestShelveInstance-218821051-project Jul 15 20:45:25.017196 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Domain-Id: default Jul 15 20:45:25.017196 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Domain-Name: Default Jul 15 20:45:25.017196 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Id: e2e27fccbf854a8b8c9d6d099893f783 Jul 15 20:45:25.017196 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Name: tempest-TestShelveInstance-218821051-project Jul 15 20:45:25.017196 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: method: > Jul 15 20:45:25.017196 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: exception: Instance b02f18ea-fd0b-4edd-97a7-17621ab67c8f could not be found. Jul 15 20:45:25.017196 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: action_args: {'id': 'b02f18ea-fd0b-4edd-97a7-17621ab67c8f'} Jul 15 20:45:25.018389 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 20:45:25.018389 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:45:25.018389 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 20:45:25.018389 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 20:45:25.018389 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 20:45:25.018389 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 20:45:25.018389 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 20:45:25.018389 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 20:45:25.018389 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 20:45:25.018389 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 20:45:25.018389 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b02f18ea-fd0b-4edd-97a7-17621ab67c8f could not be found. Jul 15 20:45:25.018389 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:45:25.018389 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:45:25.018389 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:45:25.018389 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:45:25.018389 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:45:25.018389 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:45:25.018389 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 20:45:25.018389 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 20:45:25.018389 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 20:45:25.019986 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 20:45:25.019986 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 20:45:25.019986 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 20:45:25.019986 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 20:45:25.019986 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 20:45:25.019986 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 20:45:25.019986 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 20:45:25.019986 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b02f18ea-fd0b-4edd-97a7-17621ab67c8f could not be found. Jul 15 20:45:25.019986 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:45:25.019986 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:45:25.019986 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:45:25.019986 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:45:25.019986 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:45:25.019986 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:45:25.019986 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 20:45:25.019986 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 20:45:25.019986 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b02f18ea-fd0b-4edd-97a7-17621ab67c8f could not be found. Jul 15 20:45:25.019986 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:45:25.021520 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-93c579db-104d-49fa-bf82-6adb61aee33e tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Returning 404 to user: Instance b02f18ea-fd0b-4edd-97a7-17621ab67c8f could not be found. {{(pid=124430) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 20:45:25.021520 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-93c579db-104d-49fa-bf82-6adb61aee33e tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] 10.222.0.66 "GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f" status: 404 len: 111 microversion: 2.1 time: 0.037642 Jul 15 20:45:25.021520 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 494/989] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:45:24 2022] GET /compute/v2.1/servers/b02f18ea-fd0b-4edd-97a7-17621ab67c8f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 20:45:25.342389 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-e8a6127e-5e6e-4540-87a7-822ad60ce3a2 req-836773b2-558d-4ae1-990f-2aa901405fb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39e785be-449f-47ab-9327-8b6a91f7d4c3", "tag": "ba9974a7-bd5a-4107-add7-f41006769a31"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:45:25.352087 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-e8a6127e-5e6e-4540-87a7-822ad60ce3a2 req-836773b2-558d-4ae1-990f-2aa901405fb2 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:25.353273 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-e8a6127e-5e6e-4540-87a7-822ad60ce3a2 req-836773b2-558d-4ae1-990f-2aa901405fb2 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:25.353421 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-13f5a1fc-2513-4634-9062-b6329008e6b2 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] Calling method '.version_select at 0x7ff51c303ee0>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:45:25.365920 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-e8a6127e-5e6e-4540-87a7-822ad60ce3a2 req-836773b2-558d-4ae1-990f-2aa901405fb2 service nova] Creating event network-changed:ba9974a7-bd5a-4107-add7-f41006769a31 for instance 39e785be-449f-47ab-9327-8b6a91f7d4c3 on hv-cinder-79987 Jul 15 20:45:25.371270 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-e8a6127e-5e6e-4540-87a7-822ad60ce3a2 req-836773b2-558d-4ae1-990f-2aa901405fb2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033258 Jul 15 20:45:25.372590 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 496/990] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:45:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:45:25.377233 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-13f5a1fc-2513-4634-9062-b6329008e6b2 tempest-TestShelveInstance-218821051 tempest-TestShelveInstance-218821051-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-203258470" status: 202 len: 0 microversion: 2.1 time: 0.027773 Jul 15 20:45:25.378125 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 495/991] 10.222.0.66 () {58 vars in 1250 bytes} [Fri Jul 15 20:45:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-203258470 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 15 20:45:25.733825 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-c5a36a4e-6eb7-490d-8172-9fa993792314 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:45:25.734613 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-c5a36a4e-6eb7-490d-8172-9fa993792314 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 39e785be-449f-47ab-9327-8b6a91f7d4c3] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:45:25.741116 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c5a36a4e-6eb7-490d-8172-9fa993792314 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:25.741559 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c5a36a4e-6eb7-490d-8172-9fa993792314 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:25.742323 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c5a36a4e-6eb7-490d-8172-9fa993792314 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:25.742753 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c5a36a4e-6eb7-490d-8172-9fa993792314 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:25.874501 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-c5a36a4e-6eb7-490d-8172-9fa993792314 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:45:25.882700 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-c5a36a4e-6eb7-490d-8172-9fa993792314 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:45:25.884223 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-c5a36a4e-6eb7-490d-8172-9fa993792314 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:45:25.885346 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-c5a36a4e-6eb7-490d-8172-9fa993792314 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3" status: 200 len: 1407 microversion: 2.20 time: 0.156409 Jul 15 20:45:25.885901 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 497/992] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:45:25 2022] GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:45:26.904009 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-a92ffcac-9de9-4f78-8b80-591b4aa34c55 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:45:26.904621 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-a92ffcac-9de9-4f78-8b80-591b4aa34c55 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 39e785be-449f-47ab-9327-8b6a91f7d4c3] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:45:26.911209 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-a92ffcac-9de9-4f78-8b80-591b4aa34c55 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:26.911648 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-a92ffcac-9de9-4f78-8b80-591b4aa34c55 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:26.912411 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-a92ffcac-9de9-4f78-8b80-591b4aa34c55 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:26.912843 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-a92ffcac-9de9-4f78-8b80-591b4aa34c55 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:27.040770 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-a92ffcac-9de9-4f78-8b80-591b4aa34c55 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:45:27.049177 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-a92ffcac-9de9-4f78-8b80-591b4aa34c55 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:45:27.050681 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-a92ffcac-9de9-4f78-8b80-591b4aa34c55 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:45:27.051780 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-a92ffcac-9de9-4f78-8b80-591b4aa34c55 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3" status: 200 len: 1407 microversion: 2.20 time: 0.152398 Jul 15 20:45:27.052322 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 496/993] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:45:26 2022] GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:45:28.070174 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-0604477f-11cb-4a1d-a0ef-4a05ab3a021b tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:45:28.070785 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-0604477f-11cb-4a1d-a0ef-4a05ab3a021b tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 39e785be-449f-47ab-9327-8b6a91f7d4c3] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:45:28.073286 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:45:28.079501 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0604477f-11cb-4a1d-a0ef-4a05ab3a021b tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:28.079955 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0604477f-11cb-4a1d-a0ef-4a05ab3a021b tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:28.080771 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0604477f-11cb-4a1d-a0ef-4a05ab3a021b tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:28.081260 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0604477f-11cb-4a1d-a0ef-4a05ab3a021b tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:28.269975 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-0604477f-11cb-4a1d-a0ef-4a05ab3a021b tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:45:28.278861 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-0604477f-11cb-4a1d-a0ef-4a05ab3a021b tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:45:28.280600 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-0604477f-11cb-4a1d-a0ef-4a05ab3a021b tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:45:28.281692 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-0604477f-11cb-4a1d-a0ef-4a05ab3a021b tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3" status: 200 len: 1407 microversion: 2.20 time: 0.215466 Jul 15 20:45:28.282243 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 498/994] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:45:28 2022] GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3 => generated 1407 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:45:29.299270 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-f0ec37b0-9963-42c4-81be-8d7ac7fad41c tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:45:29.299859 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-f0ec37b0-9963-42c4-81be-8d7ac7fad41c tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 39e785be-449f-47ab-9327-8b6a91f7d4c3] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:45:29.302278 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:45:29.311506 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-f0ec37b0-9963-42c4-81be-8d7ac7fad41c tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:29.311506 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-f0ec37b0-9963-42c4-81be-8d7ac7fad41c tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:29.311506 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-f0ec37b0-9963-42c4-81be-8d7ac7fad41c tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:29.311506 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-f0ec37b0-9963-42c4-81be-8d7ac7fad41c tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:29.557542 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-f0ec37b0-9963-42c4-81be-8d7ac7fad41c tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:45:29.569335 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-f0ec37b0-9963-42c4-81be-8d7ac7fad41c tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:45:29.570822 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-f0ec37b0-9963-42c4-81be-8d7ac7fad41c tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:45:29.571917 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-f0ec37b0-9963-42c4-81be-8d7ac7fad41c tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3" status: 200 len: 1407 microversion: 2.20 time: 0.276629 Jul 15 20:45:29.572682 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 497/995] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:45:29 2022] GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3 => generated 1407 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:45:30.589979 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-3a9c4820-2e90-4058-8ad9-bedb7026014a tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:45:30.591423 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-3a9c4820-2e90-4058-8ad9-bedb7026014a tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 39e785be-449f-47ab-9327-8b6a91f7d4c3] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:45:30.598519 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3a9c4820-2e90-4058-8ad9-bedb7026014a tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:30.599022 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3a9c4820-2e90-4058-8ad9-bedb7026014a tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:30.599900 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3a9c4820-2e90-4058-8ad9-bedb7026014a tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:30.600475 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3a9c4820-2e90-4058-8ad9-bedb7026014a tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:30.786915 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-3a9c4820-2e90-4058-8ad9-bedb7026014a tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:45:30.797403 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-3a9c4820-2e90-4058-8ad9-bedb7026014a tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:45:30.799048 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-3a9c4820-2e90-4058-8ad9-bedb7026014a tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:45:30.800499 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-3a9c4820-2e90-4058-8ad9-bedb7026014a tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3" status: 200 len: 1407 microversion: 2.20 time: 0.214476 Jul 15 20:45:30.801180 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 499/996] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:45:30 2022] GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3 => generated 1407 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:45:31.055897 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [req-df5b7150-c91a-46be-8ba0-7438f4b96df5 req-168043ef-9af0-4c51-a61d-6622f4482b75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39e785be-449f-47ab-9327-8b6a91f7d4c3", "name": "network-vif-plugged", "status": "completed", "tag": "ba9974a7-bd5a-4107-add7-f41006769a31"}]} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:45:31.065343 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-df5b7150-c91a-46be-8ba0-7438f4b96df5 req-168043ef-9af0-4c51-a61d-6622f4482b75 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:31.065958 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-df5b7150-c91a-46be-8ba0-7438f4b96df5 req-168043ef-9af0-4c51-a61d-6622f4482b75 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:31.077880 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.compute.server_external_events [req-df5b7150-c91a-46be-8ba0-7438f4b96df5 req-168043ef-9af0-4c51-a61d-6622f4482b75 service nova] Creating event network-vif-plugged:ba9974a7-bd5a-4107-add7-f41006769a31 for instance 39e785be-449f-47ab-9327-8b6a91f7d4c3 on hv-cinder-79987 Jul 15 20:45:31.083073 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [req-df5b7150-c91a-46be-8ba0-7438f4b96df5 req-168043ef-9af0-4c51-a61d-6622f4482b75 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031439 Jul 15 20:45:31.083882 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 498/997] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:45:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:45:31.819161 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-e63cfb05-3369-4359-a206-c7863ec86fda tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:45:31.820136 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-e63cfb05-3369-4359-a206-c7863ec86fda tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 39e785be-449f-47ab-9327-8b6a91f7d4c3] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:45:31.827456 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e63cfb05-3369-4359-a206-c7863ec86fda tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:31.828623 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e63cfb05-3369-4359-a206-c7863ec86fda tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:31.829711 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e63cfb05-3369-4359-a206-c7863ec86fda tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:31.830639 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e63cfb05-3369-4359-a206-c7863ec86fda tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:31.987021 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-e63cfb05-3369-4359-a206-c7863ec86fda tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:45:31.999606 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-e63cfb05-3369-4359-a206-c7863ec86fda tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:45:32.002100 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-e63cfb05-3369-4359-a206-c7863ec86fda tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:45:32.003503 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-e63cfb05-3369-4359-a206-c7863ec86fda tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3" status: 200 len: 1407 microversion: 2.20 time: 0.188230 Jul 15 20:45:32.008914 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 500/998] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:45:31 2022] GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3 => generated 1407 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:45:33.018827 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_cell0:SELECT=6 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:45:33.023643 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-f78516b7-2983-473e-bd78-ae3a68d7a7e2 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:45:33.024444 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-f78516b7-2983-473e-bd78-ae3a68d7a7e2 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 39e785be-449f-47ab-9327-8b6a91f7d4c3] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:45:33.032033 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-f78516b7-2983-473e-bd78-ae3a68d7a7e2 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:33.032496 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-f78516b7-2983-473e-bd78-ae3a68d7a7e2 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:33.033256 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-f78516b7-2983-473e-bd78-ae3a68d7a7e2 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:33.033683 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-f78516b7-2983-473e-bd78-ae3a68d7a7e2 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:33.207095 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-f78516b7-2983-473e-bd78-ae3a68d7a7e2 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:45:33.214817 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-f78516b7-2983-473e-bd78-ae3a68d7a7e2 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:45:33.216301 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-f78516b7-2983-473e-bd78-ae3a68d7a7e2 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:45:33.217467 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-f78516b7-2983-473e-bd78-ae3a68d7a7e2 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3" status: 200 len: 1599 microversion: 2.20 time: 0.200036 Jul 15 20:45:33.218005 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 499/999] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:45:33 2022] GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3 => generated 1599 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:45:33.234931 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-9ab4dec1-8a4f-4d84-bdc1-64b7ae176a67 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:45:33.235474 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-9ab4dec1-8a4f-4d84-bdc1-64b7ae176a67 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 39e785be-449f-47ab-9327-8b6a91f7d4c3] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:45:33.237323 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell0:SELECT=2 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:45:33.238109 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell0:SELECT=6 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:45:33.244457 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9ab4dec1-8a4f-4d84-bdc1-64b7ae176a67 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:33.244900 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9ab4dec1-8a4f-4d84-bdc1-64b7ae176a67 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:33.245661 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9ab4dec1-8a4f-4d84-bdc1-64b7ae176a67 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:33.246089 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9ab4dec1-8a4f-4d84-bdc1-64b7ae176a67 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:33.345381 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-9ab4dec1-8a4f-4d84-bdc1-64b7ae176a67 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.114833 Jul 15 20:45:33.346509 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 501/1000] 10.222.0.66 () {60 vars in 1315 bytes} [Fri Jul 15 20:45:33 2022] GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3/os-interface => generated 285 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 20:45:34.291265 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [req-016fe4a9-3f33-4371-950c-2e0399dd90c6 req-471ab285-504e-440e-94f5-b9f6caaada62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39e785be-449f-47ab-9327-8b6a91f7d4c3", "tag": "ba9974a7-bd5a-4107-add7-f41006769a31"}]} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:45:34.301300 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-016fe4a9-3f33-4371-950c-2e0399dd90c6 req-471ab285-504e-440e-94f5-b9f6caaada62 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:45:34.301742 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-016fe4a9-3f33-4371-950c-2e0399dd90c6 req-471ab285-504e-440e-94f5-b9f6caaada62 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:45:34.312772 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.compute.server_external_events [req-016fe4a9-3f33-4371-950c-2e0399dd90c6 req-471ab285-504e-440e-94f5-b9f6caaada62 service nova] Creating event network-changed:ba9974a7-bd5a-4107-add7-f41006769a31 for instance 39e785be-449f-47ab-9327-8b6a91f7d4c3 on hv-cinder-79987 Jul 15 20:45:34.318095 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [req-016fe4a9-3f33-4371-950c-2e0399dd90c6 req-471ab285-504e-440e-94f5-b9f6caaada62 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031471 Jul 15 20:45:34.318901 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 500/1001] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:45:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:46:10.465621 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_api:SELECT=7 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:46:10.466193 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell1:SELECT=42 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:46:10.470541 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-a5198bdb-4b74-4428-a658-f1cb272b77e4 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:46:10.471027 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-a5198bdb-4b74-4428-a658-f1cb272b77e4 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 39e785be-449f-47ab-9327-8b6a91f7d4c3] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:46:10.477789 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a5198bdb-4b74-4428-a658-f1cb272b77e4 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:10.478232 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a5198bdb-4b74-4428-a658-f1cb272b77e4 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:10.478991 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a5198bdb-4b74-4428-a658-f1cb272b77e4 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:10.479421 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a5198bdb-4b74-4428-a658-f1cb272b77e4 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:10.502500 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-a5198bdb-4b74-4428-a658-f1cb272b77e4 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3/ips" status: 200 len: 152 microversion: 2.20 time: 0.038671 Jul 15 20:46:10.503058 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 502/1002] 10.222.0.66 () {60 vars in 1288 bytes} [Fri Jul 15 20:46:10 2022] GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3/ips => generated 152 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 20:46:12.854800 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-597889f3-60c9-4995-bcd2-e30081b4e1ee tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:46:12.855425 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-597889f3-60c9-4995-bcd2-e30081b4e1ee tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 39e785be-449f-47ab-9327-8b6a91f7d4c3] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:46:12.858222 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_api:SELECT=7 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:46:12.858870 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_cell1:SELECT=22 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:46:12.865133 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-597889f3-60c9-4995-bcd2-e30081b4e1ee tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:12.865586 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-597889f3-60c9-4995-bcd2-e30081b4e1ee tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:12.866347 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-597889f3-60c9-4995-bcd2-e30081b4e1ee tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:12.866782 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-597889f3-60c9-4995-bcd2-e30081b4e1ee tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:12.890204 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.objects.instance [None req-597889f3-60c9-4995-bcd2-e30081b4e1ee tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lazy-loading 'flavor' on Instance uuid 39e785be-449f-47ab-9327-8b6a91f7d4c3 {{(pid=124430) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 20:46:13.142571 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-597889f3-60c9-4995-bcd2-e30081b4e1ee tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "POST /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3/action" status: 202 len: 0 microversion: 2.20 time: 0.291884 Jul 15 20:46:13.143174 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 501/1003] 10.222.0.66 () {62 vars in 1318 bytes} [Fri Jul 15 20:46:12 2022] POST /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3/action => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 15 20:46:13.151385 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-7a88510c-3e64-4388-ba06-e1093391a38d tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:46:13.152033 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-7a88510c-3e64-4388-ba06-e1093391a38d tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 39e785be-449f-47ab-9327-8b6a91f7d4c3] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:46:13.159054 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7a88510c-3e64-4388-ba06-e1093391a38d tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:13.159523 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7a88510c-3e64-4388-ba06-e1093391a38d tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:13.160355 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7a88510c-3e64-4388-ba06-e1093391a38d tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:13.160885 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7a88510c-3e64-4388-ba06-e1093391a38d tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:13.292331 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-7a88510c-3e64-4388-ba06-e1093391a38d tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:13.301722 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-7a88510c-3e64-4388-ba06-e1093391a38d tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:13.303228 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-7a88510c-3e64-4388-ba06-e1093391a38d tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:13.304411 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-7a88510c-3e64-4388-ba06-e1093391a38d tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3" status: 200 len: 1724 microversion: 2.20 time: 0.156971 Jul 15 20:46:13.304961 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 503/1004] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:46:13 2022] GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:46:14.322836 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-ee9d8687-7907-401c-b040-18bfefa3dffe tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:46:14.323541 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-ee9d8687-7907-401c-b040-18bfefa3dffe tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 39e785be-449f-47ab-9327-8b6a91f7d4c3] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:46:14.330515 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-ee9d8687-7907-401c-b040-18bfefa3dffe tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:14.330967 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-ee9d8687-7907-401c-b040-18bfefa3dffe tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:14.331732 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-ee9d8687-7907-401c-b040-18bfefa3dffe tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:14.332169 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-ee9d8687-7907-401c-b040-18bfefa3dffe tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:14.463717 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-ee9d8687-7907-401c-b040-18bfefa3dffe tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:14.471956 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-ee9d8687-7907-401c-b040-18bfefa3dffe tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:14.473476 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-ee9d8687-7907-401c-b040-18bfefa3dffe tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:14.474627 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-ee9d8687-7907-401c-b040-18bfefa3dffe tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3" status: 200 len: 1724 microversion: 2.20 time: 0.156694 Jul 15 20:46:14.475176 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 502/1005] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:46:14 2022] GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:46:15.493538 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-c7613da7-bb73-4bd8-b9e0-435765e513ab tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:46:15.494139 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-c7613da7-bb73-4bd8-b9e0-435765e513ab tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 39e785be-449f-47ab-9327-8b6a91f7d4c3] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:46:15.500638 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c7613da7-bb73-4bd8-b9e0-435765e513ab tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:15.501078 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c7613da7-bb73-4bd8-b9e0-435765e513ab tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:15.501834 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c7613da7-bb73-4bd8-b9e0-435765e513ab tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:15.502291 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c7613da7-bb73-4bd8-b9e0-435765e513ab tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:15.631040 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-c7613da7-bb73-4bd8-b9e0-435765e513ab tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:15.639515 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-c7613da7-bb73-4bd8-b9e0-435765e513ab tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:15.641044 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-c7613da7-bb73-4bd8-b9e0-435765e513ab tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:15.642191 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-c7613da7-bb73-4bd8-b9e0-435765e513ab tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3" status: 200 len: 1724 microversion: 2.20 time: 0.152557 Jul 15 20:46:15.642746 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 504/1006] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:46:15 2022] GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:46:16.660601 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-f0cc61ec-316e-4ce2-b8ac-e61650f614c5 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:46:16.661215 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-f0cc61ec-316e-4ce2-b8ac-e61650f614c5 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 39e785be-449f-47ab-9327-8b6a91f7d4c3] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:46:16.667997 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-f0cc61ec-316e-4ce2-b8ac-e61650f614c5 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:16.669522 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-f0cc61ec-316e-4ce2-b8ac-e61650f614c5 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:16.670290 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-f0cc61ec-316e-4ce2-b8ac-e61650f614c5 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:16.670739 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-f0cc61ec-316e-4ce2-b8ac-e61650f614c5 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:16.800419 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-f0cc61ec-316e-4ce2-b8ac-e61650f614c5 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:16.808189 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-f0cc61ec-316e-4ce2-b8ac-e61650f614c5 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:16.810858 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-f0cc61ec-316e-4ce2-b8ac-e61650f614c5 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:16.812016 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-f0cc61ec-316e-4ce2-b8ac-e61650f614c5 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3" status: 200 len: 1724 microversion: 2.20 time: 0.155343 Jul 15 20:46:16.812602 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 503/1007] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:46:16 2022] GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:46:17.830794 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-7c9ed09b-2124-4ee9-983c-cbd32dc179fc tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:46:17.831324 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-7c9ed09b-2124-4ee9-983c-cbd32dc179fc tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 39e785be-449f-47ab-9327-8b6a91f7d4c3] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:46:17.837901 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7c9ed09b-2124-4ee9-983c-cbd32dc179fc tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:17.838353 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7c9ed09b-2124-4ee9-983c-cbd32dc179fc tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:17.839119 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7c9ed09b-2124-4ee9-983c-cbd32dc179fc tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:17.839571 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7c9ed09b-2124-4ee9-983c-cbd32dc179fc tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:17.966974 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-7c9ed09b-2124-4ee9-983c-cbd32dc179fc tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:17.974971 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-7c9ed09b-2124-4ee9-983c-cbd32dc179fc tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:17.976504 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-7c9ed09b-2124-4ee9-983c-cbd32dc179fc tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:17.977658 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-7c9ed09b-2124-4ee9-983c-cbd32dc179fc tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3" status: 200 len: 1724 microversion: 2.20 time: 0.150866 Jul 15 20:46:17.978218 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 505/1008] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:46:17 2022] GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:46:18.997096 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-eede0036-22d1-4e5a-b121-77f12022a744 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:46:18.997702 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-eede0036-22d1-4e5a-b121-77f12022a744 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 39e785be-449f-47ab-9327-8b6a91f7d4c3] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:46:19.004227 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-eede0036-22d1-4e5a-b121-77f12022a744 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:19.004705 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-eede0036-22d1-4e5a-b121-77f12022a744 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:19.005463 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-eede0036-22d1-4e5a-b121-77f12022a744 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:19.005894 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-eede0036-22d1-4e5a-b121-77f12022a744 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:19.138388 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-eede0036-22d1-4e5a-b121-77f12022a744 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:19.146282 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-eede0036-22d1-4e5a-b121-77f12022a744 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:19.147775 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-eede0036-22d1-4e5a-b121-77f12022a744 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:19.148954 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-eede0036-22d1-4e5a-b121-77f12022a744 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3" status: 200 len: 1724 microversion: 2.20 time: 0.156388 Jul 15 20:46:19.149504 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 504/1009] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:46:18 2022] GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:46:20.167251 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-33452523-0094-428c-b06d-38fb95b834f4 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:46:20.167856 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-33452523-0094-428c-b06d-38fb95b834f4 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 39e785be-449f-47ab-9327-8b6a91f7d4c3] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:46:20.175488 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-33452523-0094-428c-b06d-38fb95b834f4 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:20.175940 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-33452523-0094-428c-b06d-38fb95b834f4 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:20.176745 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-33452523-0094-428c-b06d-38fb95b834f4 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:20.177181 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-33452523-0094-428c-b06d-38fb95b834f4 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:20.305426 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-33452523-0094-428c-b06d-38fb95b834f4 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:20.313742 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-33452523-0094-428c-b06d-38fb95b834f4 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:20.315253 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-33452523-0094-428c-b06d-38fb95b834f4 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:20.316472 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-33452523-0094-428c-b06d-38fb95b834f4 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3" status: 200 len: 1724 microversion: 2.20 time: 0.153351 Jul 15 20:46:20.317024 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 506/1010] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:46:20 2022] GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:46:21.334618 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-cc0a5930-c4bd-48ec-a63e-c26f39eebd46 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:46:21.335213 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-cc0a5930-c4bd-48ec-a63e-c26f39eebd46 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 39e785be-449f-47ab-9327-8b6a91f7d4c3] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:46:21.341266 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-cc0a5930-c4bd-48ec-a63e-c26f39eebd46 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:21.341706 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-cc0a5930-c4bd-48ec-a63e-c26f39eebd46 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:21.342456 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-cc0a5930-c4bd-48ec-a63e-c26f39eebd46 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:21.342885 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-cc0a5930-c4bd-48ec-a63e-c26f39eebd46 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:21.472500 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-cc0a5930-c4bd-48ec-a63e-c26f39eebd46 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:21.480593 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-cc0a5930-c4bd-48ec-a63e-c26f39eebd46 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:21.482800 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-cc0a5930-c4bd-48ec-a63e-c26f39eebd46 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:21.483939 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-cc0a5930-c4bd-48ec-a63e-c26f39eebd46 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3" status: 200 len: 1724 microversion: 2.20 time: 0.153440 Jul 15 20:46:21.484530 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 505/1011] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:46:21 2022] GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:46:22.502277 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-b345095d-7325-4b86-8d90-e8ba8351b2e1 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:46:22.502881 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-b345095d-7325-4b86-8d90-e8ba8351b2e1 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 39e785be-449f-47ab-9327-8b6a91f7d4c3] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:46:22.509625 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b345095d-7325-4b86-8d90-e8ba8351b2e1 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:22.510070 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b345095d-7325-4b86-8d90-e8ba8351b2e1 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:22.510823 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b345095d-7325-4b86-8d90-e8ba8351b2e1 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:22.511252 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b345095d-7325-4b86-8d90-e8ba8351b2e1 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:22.640256 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-b345095d-7325-4b86-8d90-e8ba8351b2e1 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:22.648919 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-b345095d-7325-4b86-8d90-e8ba8351b2e1 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:22.650354 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-b345095d-7325-4b86-8d90-e8ba8351b2e1 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:22.651532 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-b345095d-7325-4b86-8d90-e8ba8351b2e1 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3" status: 200 len: 1724 microversion: 2.20 time: 0.153131 Jul 15 20:46:22.652082 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 507/1012] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:46:22 2022] GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:46:23.669693 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-b8a70933-fd9a-4d5d-a111-1f7e3f06cc41 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:46:23.670336 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-b8a70933-fd9a-4d5d-a111-1f7e3f06cc41 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 39e785be-449f-47ab-9327-8b6a91f7d4c3] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:46:23.676958 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b8a70933-fd9a-4d5d-a111-1f7e3f06cc41 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:23.677401 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b8a70933-fd9a-4d5d-a111-1f7e3f06cc41 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:23.678148 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b8a70933-fd9a-4d5d-a111-1f7e3f06cc41 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:23.678600 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b8a70933-fd9a-4d5d-a111-1f7e3f06cc41 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:23.811907 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-b8a70933-fd9a-4d5d-a111-1f7e3f06cc41 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:23.819717 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-b8a70933-fd9a-4d5d-a111-1f7e3f06cc41 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:23.821300 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-b8a70933-fd9a-4d5d-a111-1f7e3f06cc41 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:23.822444 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-b8a70933-fd9a-4d5d-a111-1f7e3f06cc41 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3" status: 200 len: 1745 microversion: 2.20 time: 0.157184 Jul 15 20:46:23.822990 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 506/1013] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:46:23 2022] GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3 => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:46:24.841415 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-3ffc5121-4528-4729-b3d2-bcb234a4b019 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:46:24.841982 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-3ffc5121-4528-4729-b3d2-bcb234a4b019 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 39e785be-449f-47ab-9327-8b6a91f7d4c3] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:46:24.848610 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3ffc5121-4528-4729-b3d2-bcb234a4b019 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:24.849058 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3ffc5121-4528-4729-b3d2-bcb234a4b019 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:24.849818 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3ffc5121-4528-4729-b3d2-bcb234a4b019 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:24.850248 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3ffc5121-4528-4729-b3d2-bcb234a4b019 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:24.983999 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-3ffc5121-4528-4729-b3d2-bcb234a4b019 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:24.991904 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-3ffc5121-4528-4729-b3d2-bcb234a4b019 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:24.993461 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-3ffc5121-4528-4729-b3d2-bcb234a4b019 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:24.994607 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-3ffc5121-4528-4729-b3d2-bcb234a4b019 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3" status: 200 len: 1745 microversion: 2.20 time: 0.157320 Jul 15 20:46:24.995166 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 508/1014] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:46:24 2022] GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3 => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:46:26.015940 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-9a0cf11a-aa34-4756-9114-cfecaa1e69e1 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:46:26.016672 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-9a0cf11a-aa34-4756-9114-cfecaa1e69e1 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 39e785be-449f-47ab-9327-8b6a91f7d4c3] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:46:26.023387 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-9a0cf11a-aa34-4756-9114-cfecaa1e69e1 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:26.023829 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-9a0cf11a-aa34-4756-9114-cfecaa1e69e1 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:26.024616 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-9a0cf11a-aa34-4756-9114-cfecaa1e69e1 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:26.025047 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-9a0cf11a-aa34-4756-9114-cfecaa1e69e1 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:26.161510 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-9a0cf11a-aa34-4756-9114-cfecaa1e69e1 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:26.172070 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-9a0cf11a-aa34-4756-9114-cfecaa1e69e1 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:26.173705 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-9a0cf11a-aa34-4756-9114-cfecaa1e69e1 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:26.174871 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-9a0cf11a-aa34-4756-9114-cfecaa1e69e1 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3" status: 200 len: 1740 microversion: 2.20 time: 0.163310 Jul 15 20:46:26.175417 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 507/1015] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:46:26 2022] GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3 => generated 1740 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:46:27.195486 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-df076c67-1ff1-4c6e-9281-0f5c38bf8b4c tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:46:27.196216 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-df076c67-1ff1-4c6e-9281-0f5c38bf8b4c tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 39e785be-449f-47ab-9327-8b6a91f7d4c3] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:46:27.203239 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-df076c67-1ff1-4c6e-9281-0f5c38bf8b4c tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:27.204034 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-df076c67-1ff1-4c6e-9281-0f5c38bf8b4c tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:27.205070 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-df076c67-1ff1-4c6e-9281-0f5c38bf8b4c tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:27.205725 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-df076c67-1ff1-4c6e-9281-0f5c38bf8b4c tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:27.368650 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-df076c67-1ff1-4c6e-9281-0f5c38bf8b4c tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:27.379700 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-df076c67-1ff1-4c6e-9281-0f5c38bf8b4c tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:27.381231 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-df076c67-1ff1-4c6e-9281-0f5c38bf8b4c tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:27.382459 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-df076c67-1ff1-4c6e-9281-0f5c38bf8b4c tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3" status: 200 len: 1740 microversion: 2.20 time: 0.192532 Jul 15 20:46:27.383346 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 509/1016] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:46:27 2022] GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3 => generated 1740 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 20:46:28.400981 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-60c1879b-fca1-452a-9a02-a7201eaa2bec tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:46:28.402797 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-60c1879b-fca1-452a-9a02-a7201eaa2bec tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 39e785be-449f-47ab-9327-8b6a91f7d4c3] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:46:28.411233 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-60c1879b-fca1-452a-9a02-a7201eaa2bec tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:28.411683 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-60c1879b-fca1-452a-9a02-a7201eaa2bec tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:28.412473 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-60c1879b-fca1-452a-9a02-a7201eaa2bec tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:28.412911 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-60c1879b-fca1-452a-9a02-a7201eaa2bec tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:28.563461 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-60c1879b-fca1-452a-9a02-a7201eaa2bec tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:28.571888 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-60c1879b-fca1-452a-9a02-a7201eaa2bec tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:28.573444 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-60c1879b-fca1-452a-9a02-a7201eaa2bec tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:28.574781 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-60c1879b-fca1-452a-9a02-a7201eaa2bec tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3" status: 200 len: 1740 microversion: 2.20 time: 0.178427 Jul 15 20:46:28.575528 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 508/1017] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:46:28 2022] GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3 => generated 1740 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:46:29.338525 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-c3706718-ad2f-4fab-9bfc-12a2bc5bc283 req-1ef08a3d-33f5-4bda-ad71-373efa64f748 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39e785be-449f-47ab-9327-8b6a91f7d4c3", "name": "network-vif-plugged", "status": "completed", "tag": "ba9974a7-bd5a-4107-add7-f41006769a31"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:46:29.351506 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-c3706718-ad2f-4fab-9bfc-12a2bc5bc283 req-1ef08a3d-33f5-4bda-ad71-373efa64f748 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:29.351954 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-c3706718-ad2f-4fab-9bfc-12a2bc5bc283 req-1ef08a3d-33f5-4bda-ad71-373efa64f748 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:29.363994 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-c3706718-ad2f-4fab-9bfc-12a2bc5bc283 req-1ef08a3d-33f5-4bda-ad71-373efa64f748 service nova] Creating event network-vif-plugged:ba9974a7-bd5a-4107-add7-f41006769a31 for instance 39e785be-449f-47ab-9327-8b6a91f7d4c3 on hv-cinder-79987 Jul 15 20:46:29.373354 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-c3706718-ad2f-4fab-9bfc-12a2bc5bc283 req-1ef08a3d-33f5-4bda-ad71-373efa64f748 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038493 Jul 15 20:46:29.374530 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 510/1018] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:46:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:46:29.593038 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-0b796863-5ceb-4dbf-bca5-8f8d4f51376f tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:46:29.593688 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-0b796863-5ceb-4dbf-bca5-8f8d4f51376f tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 39e785be-449f-47ab-9327-8b6a91f7d4c3] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:46:29.600797 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-0b796863-5ceb-4dbf-bca5-8f8d4f51376f tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:29.601283 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-0b796863-5ceb-4dbf-bca5-8f8d4f51376f tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:29.602106 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-0b796863-5ceb-4dbf-bca5-8f8d4f51376f tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:29.602583 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-0b796863-5ceb-4dbf-bca5-8f8d4f51376f tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:29.750620 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-0b796863-5ceb-4dbf-bca5-8f8d4f51376f tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:29.758790 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-0b796863-5ceb-4dbf-bca5-8f8d4f51376f tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:29.760616 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-0b796863-5ceb-4dbf-bca5-8f8d4f51376f tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:29.761772 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-0b796863-5ceb-4dbf-bca5-8f8d4f51376f tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3" status: 200 len: 1740 microversion: 2.20 time: 0.172821 Jul 15 20:46:29.762440 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 509/1019] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:46:29 2022] GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3 => generated 1740 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:46:30.782586 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-370ea6f4-3f33-497a-9c71-ab689d239457 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:46:30.785118 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-370ea6f4-3f33-497a-9c71-ab689d239457 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 39e785be-449f-47ab-9327-8b6a91f7d4c3] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:46:30.794107 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-370ea6f4-3f33-497a-9c71-ab689d239457 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:30.794852 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-370ea6f4-3f33-497a-9c71-ab689d239457 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:30.795797 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-370ea6f4-3f33-497a-9c71-ab689d239457 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:30.796532 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-370ea6f4-3f33-497a-9c71-ab689d239457 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:30.953536 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-370ea6f4-3f33-497a-9c71-ab689d239457 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:30.962594 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-370ea6f4-3f33-497a-9c71-ab689d239457 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:30.964110 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-370ea6f4-3f33-497a-9c71-ab689d239457 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:30.965577 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-370ea6f4-3f33-497a-9c71-ab689d239457 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3" status: 200 len: 1740 microversion: 2.20 time: 0.187441 Jul 15 20:46:30.966421 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 511/1020] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:46:30 2022] GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3 => generated 1740 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:46:31.984356 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-befb5102-3809-4fb6-9550-13a2958bcad0 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:46:31.985088 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-befb5102-3809-4fb6-9550-13a2958bcad0 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 39e785be-449f-47ab-9327-8b6a91f7d4c3] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:46:31.992301 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-befb5102-3809-4fb6-9550-13a2958bcad0 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:31.992803 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-befb5102-3809-4fb6-9550-13a2958bcad0 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:31.993606 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-befb5102-3809-4fb6-9550-13a2958bcad0 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:31.994040 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-befb5102-3809-4fb6-9550-13a2958bcad0 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:32.131229 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-befb5102-3809-4fb6-9550-13a2958bcad0 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:32.143393 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-befb5102-3809-4fb6-9550-13a2958bcad0 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:32.144930 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-befb5102-3809-4fb6-9550-13a2958bcad0 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:32.146103 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-befb5102-3809-4fb6-9550-13a2958bcad0 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3" status: 200 len: 1740 microversion: 2.20 time: 0.166004 Jul 15 20:46:32.146653 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 510/1021] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:46:31 2022] GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3 => generated 1740 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:46:33.164733 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-9420961b-8efe-4d25-a466-302ceb9ea376 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:46:33.165537 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-9420961b-8efe-4d25-a466-302ceb9ea376 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 39e785be-449f-47ab-9327-8b6a91f7d4c3] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:46:33.173142 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9420961b-8efe-4d25-a466-302ceb9ea376 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:33.173674 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9420961b-8efe-4d25-a466-302ceb9ea376 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:33.174510 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9420961b-8efe-4d25-a466-302ceb9ea376 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:33.175010 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9420961b-8efe-4d25-a466-302ceb9ea376 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:33.326396 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-9420961b-8efe-4d25-a466-302ceb9ea376 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:33.337115 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-9420961b-8efe-4d25-a466-302ceb9ea376 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:33.338688 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-9420961b-8efe-4d25-a466-302ceb9ea376 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:33.339863 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-9420961b-8efe-4d25-a466-302ceb9ea376 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3" status: 200 len: 1740 microversion: 2.20 time: 0.179238 Jul 15 20:46:33.341090 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 512/1022] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:46:33 2022] GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3 => generated 1740 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 20:46:34.358898 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-12ef4325-e49e-4470-abc1-47ce0ea8745b tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:46:34.360123 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-12ef4325-e49e-4470-abc1-47ce0ea8745b tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 39e785be-449f-47ab-9327-8b6a91f7d4c3] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:46:34.366919 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-12ef4325-e49e-4470-abc1-47ce0ea8745b tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:34.367375 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-12ef4325-e49e-4470-abc1-47ce0ea8745b tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:34.368154 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-12ef4325-e49e-4470-abc1-47ce0ea8745b tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:34.368637 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-12ef4325-e49e-4470-abc1-47ce0ea8745b tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:34.526598 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-12ef4325-e49e-4470-abc1-47ce0ea8745b tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:34.536055 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-12ef4325-e49e-4470-abc1-47ce0ea8745b tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:34.537899 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-12ef4325-e49e-4470-abc1-47ce0ea8745b tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:34.539196 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-12ef4325-e49e-4470-abc1-47ce0ea8745b tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3" status: 200 len: 1740 microversion: 2.20 time: 0.184722 Jul 15 20:46:34.539772 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 511/1023] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:46:34 2022] GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3 => generated 1740 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:46:35.558403 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-beb5aee3-7ce0-49c2-87f4-3b44bba24557 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:46:35.560095 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-beb5aee3-7ce0-49c2-87f4-3b44bba24557 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 39e785be-449f-47ab-9327-8b6a91f7d4c3] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:46:35.566244 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-beb5aee3-7ce0-49c2-87f4-3b44bba24557 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:35.566681 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-beb5aee3-7ce0-49c2-87f4-3b44bba24557 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:35.567437 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-beb5aee3-7ce0-49c2-87f4-3b44bba24557 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:35.567860 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-beb5aee3-7ce0-49c2-87f4-3b44bba24557 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:35.700631 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-beb5aee3-7ce0-49c2-87f4-3b44bba24557 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:35.709199 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-beb5aee3-7ce0-49c2-87f4-3b44bba24557 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:35.710714 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-beb5aee3-7ce0-49c2-87f4-3b44bba24557 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:35.711880 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-beb5aee3-7ce0-49c2-87f4-3b44bba24557 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3" status: 200 len: 1722 microversion: 2.20 time: 0.157391 Jul 15 20:46:35.712466 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 513/1024] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:46:35 2022] GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:46:36.730070 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-d310a32a-45a0-4ced-acdf-751ff6148af5 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:46:36.730673 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-d310a32a-45a0-4ced-acdf-751ff6148af5 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 39e785be-449f-47ab-9327-8b6a91f7d4c3] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:46:36.737187 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d310a32a-45a0-4ced-acdf-751ff6148af5 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:36.737641 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d310a32a-45a0-4ced-acdf-751ff6148af5 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:36.738403 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d310a32a-45a0-4ced-acdf-751ff6148af5 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:36.738842 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d310a32a-45a0-4ced-acdf-751ff6148af5 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:36.869360 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-d310a32a-45a0-4ced-acdf-751ff6148af5 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:36.878250 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-d310a32a-45a0-4ced-acdf-751ff6148af5 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:36.879762 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-d310a32a-45a0-4ced-acdf-751ff6148af5 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:36.880955 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-d310a32a-45a0-4ced-acdf-751ff6148af5 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3" status: 200 len: 1722 microversion: 2.20 time: 0.154861 Jul 15 20:46:36.881505 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 512/1025] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:46:36 2022] GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:46:37.899263 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-6b712d37-359d-4643-acec-b1816a10e99f tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:46:37.899866 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-6b712d37-359d-4643-acec-b1816a10e99f tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 39e785be-449f-47ab-9327-8b6a91f7d4c3] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:46:37.906575 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6b712d37-359d-4643-acec-b1816a10e99f tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:37.907026 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6b712d37-359d-4643-acec-b1816a10e99f tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:37.907790 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6b712d37-359d-4643-acec-b1816a10e99f tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:37.908231 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6b712d37-359d-4643-acec-b1816a10e99f tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:38.035644 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-6b712d37-359d-4643-acec-b1816a10e99f tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:38.044109 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-6b712d37-359d-4643-acec-b1816a10e99f tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:38.045657 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-6b712d37-359d-4643-acec-b1816a10e99f tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:38.046818 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-6b712d37-359d-4643-acec-b1816a10e99f tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3" status: 200 len: 1725 microversion: 2.20 time: 0.151707 Jul 15 20:46:38.047376 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 514/1026] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:46:37 2022] GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:46:38.064859 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-787dfa6e-657b-4c2d-a752-fbb26d2552fe tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a4cc67f9-613a-4e45-9182-b5e69d0e36df"}} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:46:38.066429 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-787dfa6e-657b-4c2d-a752-fbb26d2552fe tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 39e785be-449f-47ab-9327-8b6a91f7d4c3] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:46:38.072516 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-787dfa6e-657b-4c2d-a752-fbb26d2552fe tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:38.072969 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-787dfa6e-657b-4c2d-a752-fbb26d2552fe tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:38.073728 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-787dfa6e-657b-4c2d-a752-fbb26d2552fe tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:38.074165 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-787dfa6e-657b-4c2d-a752-fbb26d2552fe tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:38.264987 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:46:38.349516 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-787dfa6e-657b-4c2d-a752-fbb26d2552fe tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "POST /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.288666 Jul 15 20:46:38.350109 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 513/1027] 10.222.0.66 () {62 vars in 1363 bytes} [Fri Jul 15 20:46:38 2022] POST /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3/os-volume_attachments => generated 188 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 20:46:38.465873 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-c1a6352d-8eea-4a37-929b-e368d471a5ce tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:46:38.466372 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-c1a6352d-8eea-4a37-929b-e368d471a5ce tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 39e785be-449f-47ab-9327-8b6a91f7d4c3] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:46:38.472382 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c1a6352d-8eea-4a37-929b-e368d471a5ce tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:38.472855 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c1a6352d-8eea-4a37-929b-e368d471a5ce tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:38.473618 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c1a6352d-8eea-4a37-929b-e368d471a5ce tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:38.474054 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c1a6352d-8eea-4a37-929b-e368d471a5ce tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:38.714783 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-c1a6352d-8eea-4a37-929b-e368d471a5ce tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "DELETE /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3/os-volume_attachments/a4cc67f9-613a-4e45-9182-b5e69d0e36df" status: 202 len: 0 microversion: 2.20 time: 0.253412 Jul 15 20:46:38.715359 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 515/1028] 10.222.0.66 () {60 vars in 1456 bytes} [Fri Jul 15 20:46:38 2022] DELETE /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3/os-volume_attachments/a4cc67f9-613a-4e45-9182-b5e69d0e36df => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 15 20:46:38.770118 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-7b3fdcba-8c99-4eab-bbbe-aae6e1e34eef tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:46:38.770638 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-7b3fdcba-8c99-4eab-bbbe-aae6e1e34eef tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 39e785be-449f-47ab-9327-8b6a91f7d4c3] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:46:38.777337 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-7b3fdcba-8c99-4eab-bbbe-aae6e1e34eef tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:38.777796 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-7b3fdcba-8c99-4eab-bbbe-aae6e1e34eef tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:38.778561 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-7b3fdcba-8c99-4eab-bbbe-aae6e1e34eef tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:38.779287 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-7b3fdcba-8c99-4eab-bbbe-aae6e1e34eef tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:38.855034 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-7b3fdcba-8c99-4eab-bbbe-aae6e1e34eef tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "POST /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3/action" status: 202 len: 0 microversion: 2.20 time: 0.088887 Jul 15 20:46:38.855704 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 514/1029] 10.222.0.66 () {62 vars in 1318 bytes} [Fri Jul 15 20:46:38 2022] POST /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 15 20:46:38.863653 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-6e47f37d-35d4-4429-ab99-d836a8a9977b tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:46:38.864263 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-6e47f37d-35d4-4429-ab99-d836a8a9977b tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 39e785be-449f-47ab-9327-8b6a91f7d4c3] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:46:38.870294 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6e47f37d-35d4-4429-ab99-d836a8a9977b tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:38.870735 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6e47f37d-35d4-4429-ab99-d836a8a9977b tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:38.871601 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6e47f37d-35d4-4429-ab99-d836a8a9977b tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:38.871926 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6e47f37d-35d4-4429-ab99-d836a8a9977b tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:39.012780 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-6e47f37d-35d4-4429-ab99-d836a8a9977b tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:39.021664 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-6e47f37d-35d4-4429-ab99-d836a8a9977b tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:39.023107 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-6e47f37d-35d4-4429-ab99-d836a8a9977b tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:39.024269 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-6e47f37d-35d4-4429-ab99-d836a8a9977b tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3" status: 200 len: 1673 microversion: 2.20 time: 0.164472 Jul 15 20:46:39.029349 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 516/1030] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:46:38 2022] GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3 => generated 1673 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:46:39.299901 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [req-a670835a-3155-4c9b-8196-d8eea034dfcd req-625dacdf-43ba-4313-9ef2-3e086c7ba7d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39e785be-449f-47ab-9327-8b6a91f7d4c3", "name": "network-vif-unplugged", "status": "completed", "tag": "ba9974a7-bd5a-4107-add7-f41006769a31"}]} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:46:39.310855 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-a670835a-3155-4c9b-8196-d8eea034dfcd req-625dacdf-43ba-4313-9ef2-3e086c7ba7d6 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:39.311394 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-a670835a-3155-4c9b-8196-d8eea034dfcd req-625dacdf-43ba-4313-9ef2-3e086c7ba7d6 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:39.323302 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.compute.server_external_events [req-a670835a-3155-4c9b-8196-d8eea034dfcd req-625dacdf-43ba-4313-9ef2-3e086c7ba7d6 service nova] Unable to find a host for instance 39e785be-449f-47ab-9327-8b6a91f7d4c3. Dropping event network-vif-unplugged {{(pid=124430) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 15 20:46:39.324272 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [req-a670835a-3155-4c9b-8196-d8eea034dfcd req-625dacdf-43ba-4313-9ef2-3e086c7ba7d6 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028942 Jul 15 20:46:39.325118 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 515/1031] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:46:39 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 15 20:46:40.042609 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-78e75e74-6e24-4e48-b6de-cfbca3dfd7e4 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:46:40.043337 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-78e75e74-6e24-4e48-b6de-cfbca3dfd7e4 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 39e785be-449f-47ab-9327-8b6a91f7d4c3] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:46:40.051379 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-78e75e74-6e24-4e48-b6de-cfbca3dfd7e4 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:40.051920 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-78e75e74-6e24-4e48-b6de-cfbca3dfd7e4 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:40.052763 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-78e75e74-6e24-4e48-b6de-cfbca3dfd7e4 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:40.053201 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-78e75e74-6e24-4e48-b6de-cfbca3dfd7e4 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:40.057521 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:46:40.188971 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-78e75e74-6e24-4e48-b6de-cfbca3dfd7e4 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:40.196923 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-78e75e74-6e24-4e48-b6de-cfbca3dfd7e4 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:40.198453 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-78e75e74-6e24-4e48-b6de-cfbca3dfd7e4 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:40.199616 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-78e75e74-6e24-4e48-b6de-cfbca3dfd7e4 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3" status: 200 len: 1731 microversion: 2.20 time: 0.161291 Jul 15 20:46:40.200175 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 517/1032] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:46:40 2022] GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3 => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:46:41.222489 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-30770fd3-2ece-4509-914c-bc64ed2fbd30 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:46:41.224207 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-30770fd3-2ece-4509-914c-bc64ed2fbd30 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 39e785be-449f-47ab-9327-8b6a91f7d4c3] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:46:41.235924 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-30770fd3-2ece-4509-914c-bc64ed2fbd30 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:41.236810 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-30770fd3-2ece-4509-914c-bc64ed2fbd30 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:41.237977 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-30770fd3-2ece-4509-914c-bc64ed2fbd30 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:41.238579 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-30770fd3-2ece-4509-914c-bc64ed2fbd30 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:41.396918 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-30770fd3-2ece-4509-914c-bc64ed2fbd30 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:41.408008 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-30770fd3-2ece-4509-914c-bc64ed2fbd30 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:41.410109 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-30770fd3-2ece-4509-914c-bc64ed2fbd30 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:41.411872 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-30770fd3-2ece-4509-914c-bc64ed2fbd30 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3" status: 200 len: 1731 microversion: 2.20 time: 0.196453 Jul 15 20:46:41.412754 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 516/1033] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:46:41 2022] GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3 => generated 1731 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:46:42.430928 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-f67648fc-77f0-4b3a-9091-3bc69b891338 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:46:42.431539 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-f67648fc-77f0-4b3a-9091-3bc69b891338 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 39e785be-449f-47ab-9327-8b6a91f7d4c3] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:46:42.433855 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_api:SELECT=33 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:46:42.441123 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f67648fc-77f0-4b3a-9091-3bc69b891338 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:42.441888 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f67648fc-77f0-4b3a-9091-3bc69b891338 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:42.443032 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f67648fc-77f0-4b3a-9091-3bc69b891338 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:42.443701 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f67648fc-77f0-4b3a-9091-3bc69b891338 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:42.717250 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-f67648fc-77f0-4b3a-9091-3bc69b891338 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:42.726168 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-f67648fc-77f0-4b3a-9091-3bc69b891338 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:42.728026 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-f67648fc-77f0-4b3a-9091-3bc69b891338 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:42.729494 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-f67648fc-77f0-4b3a-9091-3bc69b891338 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3" status: 200 len: 1731 microversion: 2.20 time: 0.302427 Jul 15 20:46:42.740661 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 518/1034] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:46:42 2022] GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3 => generated 1731 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:46:43.748998 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-875b1758-4c5b-4262-8c39-125c0717eb91 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:46:43.749609 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-875b1758-4c5b-4262-8c39-125c0717eb91 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 39e785be-449f-47ab-9327-8b6a91f7d4c3] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:46:43.751937 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_api:SELECT=35 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:46:43.757345 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-875b1758-4c5b-4262-8c39-125c0717eb91 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:43.757793 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-875b1758-4c5b-4262-8c39-125c0717eb91 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:43.758571 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-875b1758-4c5b-4262-8c39-125c0717eb91 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:43.759020 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-875b1758-4c5b-4262-8c39-125c0717eb91 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:43.905356 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-875b1758-4c5b-4262-8c39-125c0717eb91 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:43.913418 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-875b1758-4c5b-4262-8c39-125c0717eb91 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:43.914920 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-875b1758-4c5b-4262-8c39-125c0717eb91 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:43.916121 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-875b1758-4c5b-4262-8c39-125c0717eb91 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3" status: 200 len: 1731 microversion: 2.20 time: 0.171925 Jul 15 20:46:43.916724 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 517/1035] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:46:43 2022] GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3 => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:46:44.936625 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-22215dae-e11e-4f6c-b8ce-ac3dfa1f82bf tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:46:44.937878 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-22215dae-e11e-4f6c-b8ce-ac3dfa1f82bf tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 39e785be-449f-47ab-9327-8b6a91f7d4c3] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:46:44.946528 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-22215dae-e11e-4f6c-b8ce-ac3dfa1f82bf tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:44.947006 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-22215dae-e11e-4f6c-b8ce-ac3dfa1f82bf tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:44.947789 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-22215dae-e11e-4f6c-b8ce-ac3dfa1f82bf tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:44.948227 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-22215dae-e11e-4f6c-b8ce-ac3dfa1f82bf tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:45.093836 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-22215dae-e11e-4f6c-b8ce-ac3dfa1f82bf tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:45.102546 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-22215dae-e11e-4f6c-b8ce-ac3dfa1f82bf tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:45.104070 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-22215dae-e11e-4f6c-b8ce-ac3dfa1f82bf tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:45.105356 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-22215dae-e11e-4f6c-b8ce-ac3dfa1f82bf tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3" status: 200 len: 1731 microversion: 2.20 time: 0.173909 Jul 15 20:46:45.113870 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 519/1036] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:46:44 2022] GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3 => generated 1731 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:46:46.124583 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-618acc9c-aca2-4537-bd8f-4251978f484f tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:46:46.125175 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-618acc9c-aca2-4537-bd8f-4251978f484f tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 39e785be-449f-47ab-9327-8b6a91f7d4c3] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:46:46.133436 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-618acc9c-aca2-4537-bd8f-4251978f484f tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:46.133906 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-618acc9c-aca2-4537-bd8f-4251978f484f tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:46.134780 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-618acc9c-aca2-4537-bd8f-4251978f484f tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:46.135213 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-618acc9c-aca2-4537-bd8f-4251978f484f tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:46.337112 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-618acc9c-aca2-4537-bd8f-4251978f484f tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:46.345154 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-618acc9c-aca2-4537-bd8f-4251978f484f tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:46.346641 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-618acc9c-aca2-4537-bd8f-4251978f484f tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:46.347791 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-618acc9c-aca2-4537-bd8f-4251978f484f tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3" status: 200 len: 1731 microversion: 2.20 time: 0.227839 Jul 15 20:46:46.348336 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 518/1037] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:46:46 2022] GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3 => generated 1731 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:46:47.367656 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-97442890-c01d-4ad1-bcfe-95954fe18f1d tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:46:47.369264 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-97442890-c01d-4ad1-bcfe-95954fe18f1d tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 39e785be-449f-47ab-9327-8b6a91f7d4c3] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:46:47.378091 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-97442890-c01d-4ad1-bcfe-95954fe18f1d tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:47.378790 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-97442890-c01d-4ad1-bcfe-95954fe18f1d tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:47.380011 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-97442890-c01d-4ad1-bcfe-95954fe18f1d tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:47.380638 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-97442890-c01d-4ad1-bcfe-95954fe18f1d tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:47.527716 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-97442890-c01d-4ad1-bcfe-95954fe18f1d tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:47.537144 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-97442890-c01d-4ad1-bcfe-95954fe18f1d tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:47.538571 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-97442890-c01d-4ad1-bcfe-95954fe18f1d tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:47.539755 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-97442890-c01d-4ad1-bcfe-95954fe18f1d tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3" status: 200 len: 1731 microversion: 2.20 time: 0.176527 Jul 15 20:46:47.550425 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 520/1038] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:46:47 2022] GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3 => generated 1731 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:46:48.558701 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-c0a73ec1-b7e3-4dbc-a498-5ef0ae0c46cb tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:46:48.559356 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-c0a73ec1-b7e3-4dbc-a498-5ef0ae0c46cb tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 39e785be-449f-47ab-9327-8b6a91f7d4c3] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:46:48.567122 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c0a73ec1-b7e3-4dbc-a498-5ef0ae0c46cb tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:48.567741 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c0a73ec1-b7e3-4dbc-a498-5ef0ae0c46cb tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:48.568695 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c0a73ec1-b7e3-4dbc-a498-5ef0ae0c46cb tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:48.569178 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c0a73ec1-b7e3-4dbc-a498-5ef0ae0c46cb tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:48.700274 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-c0a73ec1-b7e3-4dbc-a498-5ef0ae0c46cb tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:48.708432 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-c0a73ec1-b7e3-4dbc-a498-5ef0ae0c46cb tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:48.709946 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-c0a73ec1-b7e3-4dbc-a498-5ef0ae0c46cb tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:48.711100 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-c0a73ec1-b7e3-4dbc-a498-5ef0ae0c46cb tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3" status: 200 len: 1731 microversion: 2.20 time: 0.156331 Jul 15 20:46:48.711648 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 519/1039] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:46:48 2022] GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:46:49.730076 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-3b142ef8-54a4-4f7b-9a1a-501ca18fe401 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:46:49.730678 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-3b142ef8-54a4-4f7b-9a1a-501ca18fe401 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 39e785be-449f-47ab-9327-8b6a91f7d4c3] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:46:49.737546 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3b142ef8-54a4-4f7b-9a1a-501ca18fe401 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:49.737930 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3b142ef8-54a4-4f7b-9a1a-501ca18fe401 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:49.738687 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3b142ef8-54a4-4f7b-9a1a-501ca18fe401 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:49.739117 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3b142ef8-54a4-4f7b-9a1a-501ca18fe401 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:49.869616 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-3b142ef8-54a4-4f7b-9a1a-501ca18fe401 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:49.877857 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-3b142ef8-54a4-4f7b-9a1a-501ca18fe401 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:49.879346 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-3b142ef8-54a4-4f7b-9a1a-501ca18fe401 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:49.880515 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-3b142ef8-54a4-4f7b-9a1a-501ca18fe401 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3" status: 200 len: 1731 microversion: 2.20 time: 0.154380 Jul 15 20:46:49.881300 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 521/1040] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:46:49 2022] GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:46:50.898802 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-c85b6cfd-75c5-4606-9c3d-fca9bd5d9eb7 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:46:50.899407 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-c85b6cfd-75c5-4606-9c3d-fca9bd5d9eb7 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 39e785be-449f-47ab-9327-8b6a91f7d4c3] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:46:50.906277 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c85b6cfd-75c5-4606-9c3d-fca9bd5d9eb7 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:50.906725 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c85b6cfd-75c5-4606-9c3d-fca9bd5d9eb7 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:50.907479 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c85b6cfd-75c5-4606-9c3d-fca9bd5d9eb7 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:50.907911 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c85b6cfd-75c5-4606-9c3d-fca9bd5d9eb7 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:51.034993 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-c85b6cfd-75c5-4606-9c3d-fca9bd5d9eb7 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:51.043022 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-c85b6cfd-75c5-4606-9c3d-fca9bd5d9eb7 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:51.045312 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-c85b6cfd-75c5-4606-9c3d-fca9bd5d9eb7 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:51.046556 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-c85b6cfd-75c5-4606-9c3d-fca9bd5d9eb7 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3" status: 200 len: 1731 microversion: 2.20 time: 0.151629 Jul 15 20:46:51.047112 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 520/1041] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:46:50 2022] GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:46:52.064493 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-b6511f5c-23dc-42a5-b8ae-bd0edea9f0cf tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:46:52.065050 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-b6511f5c-23dc-42a5-b8ae-bd0edea9f0cf tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 39e785be-449f-47ab-9327-8b6a91f7d4c3] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:46:52.071470 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b6511f5c-23dc-42a5-b8ae-bd0edea9f0cf tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:52.071910 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b6511f5c-23dc-42a5-b8ae-bd0edea9f0cf tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:52.072693 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b6511f5c-23dc-42a5-b8ae-bd0edea9f0cf tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:52.073116 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b6511f5c-23dc-42a5-b8ae-bd0edea9f0cf tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:52.200420 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-b6511f5c-23dc-42a5-b8ae-bd0edea9f0cf tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:52.209325 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-b6511f5c-23dc-42a5-b8ae-bd0edea9f0cf tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:52.210833 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-b6511f5c-23dc-42a5-b8ae-bd0edea9f0cf tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:52.211982 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-b6511f5c-23dc-42a5-b8ae-bd0edea9f0cf tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3" status: 200 len: 1731 microversion: 2.20 time: 0.151525 Jul 15 20:46:52.212742 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 522/1042] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:46:52 2022] GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:46:53.231076 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-822b7874-d597-4cf1-b03d-a667ce3fc535 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:46:53.231676 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-822b7874-d597-4cf1-b03d-a667ce3fc535 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 39e785be-449f-47ab-9327-8b6a91f7d4c3] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:46:53.238967 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-822b7874-d597-4cf1-b03d-a667ce3fc535 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:53.239414 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-822b7874-d597-4cf1-b03d-a667ce3fc535 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:53.240186 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-822b7874-d597-4cf1-b03d-a667ce3fc535 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:53.240799 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-822b7874-d597-4cf1-b03d-a667ce3fc535 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:53.414235 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-822b7874-d597-4cf1-b03d-a667ce3fc535 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:53.424472 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-822b7874-d597-4cf1-b03d-a667ce3fc535 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:53.426176 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-822b7874-d597-4cf1-b03d-a667ce3fc535 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:53.427356 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-822b7874-d597-4cf1-b03d-a667ce3fc535 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3" status: 200 len: 1731 microversion: 2.20 time: 0.200207 Jul 15 20:46:53.427980 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 521/1043] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:46:53 2022] GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3 => generated 1731 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:46:54.445955 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-35509811-756a-4e9a-a099-0195b74b6a84 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:46:54.446548 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-35509811-756a-4e9a-a099-0195b74b6a84 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 39e785be-449f-47ab-9327-8b6a91f7d4c3] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:46:54.453699 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-35509811-756a-4e9a-a099-0195b74b6a84 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:54.454138 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-35509811-756a-4e9a-a099-0195b74b6a84 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:54.454894 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-35509811-756a-4e9a-a099-0195b74b6a84 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:54.455319 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-35509811-756a-4e9a-a099-0195b74b6a84 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:54.581655 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-35509811-756a-4e9a-a099-0195b74b6a84 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:54.590734 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-35509811-756a-4e9a-a099-0195b74b6a84 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:54.593540 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-35509811-756a-4e9a-a099-0195b74b6a84 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:54.594722 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-35509811-756a-4e9a-a099-0195b74b6a84 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3" status: 200 len: 1731 microversion: 2.20 time: 0.152731 Jul 15 20:46:54.595276 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 523/1044] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:46:54 2022] GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:46:55.448184 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [req-06cb4361-15a4-48e5-b9e4-98d653545038 req-7100e3b6-d23e-4d6f-bd1c-6a34e5d7819f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39e785be-449f-47ab-9327-8b6a91f7d4c3", "name": "network-vif-plugged", "status": "completed", "tag": "ba9974a7-bd5a-4107-add7-f41006769a31"}]} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:46:55.458863 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-06cb4361-15a4-48e5-b9e4-98d653545038 req-7100e3b6-d23e-4d6f-bd1c-6a34e5d7819f service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:55.459379 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-06cb4361-15a4-48e5-b9e4-98d653545038 req-7100e3b6-d23e-4d6f-bd1c-6a34e5d7819f service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:55.471487 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.compute.server_external_events [req-06cb4361-15a4-48e5-b9e4-98d653545038 req-7100e3b6-d23e-4d6f-bd1c-6a34e5d7819f service nova] Creating event network-vif-plugged:ba9974a7-bd5a-4107-add7-f41006769a31 for instance 39e785be-449f-47ab-9327-8b6a91f7d4c3 on hv-cinder-79987 Jul 15 20:46:55.476549 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [req-06cb4361-15a4-48e5-b9e4-98d653545038 req-7100e3b6-d23e-4d6f-bd1c-6a34e5d7819f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032484 Jul 15 20:46:55.477130 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 522/1045] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:46:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:46:55.615037 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-f7204794-82d1-41d6-a21d-bf9899c51813 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:46:55.615582 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-f7204794-82d1-41d6-a21d-bf9899c51813 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 39e785be-449f-47ab-9327-8b6a91f7d4c3] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:46:55.622156 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f7204794-82d1-41d6-a21d-bf9899c51813 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:55.623332 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f7204794-82d1-41d6-a21d-bf9899c51813 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:55.624096 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f7204794-82d1-41d6-a21d-bf9899c51813 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:55.624566 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f7204794-82d1-41d6-a21d-bf9899c51813 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:55.758289 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-f7204794-82d1-41d6-a21d-bf9899c51813 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:55.766715 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-f7204794-82d1-41d6-a21d-bf9899c51813 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:55.768253 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-f7204794-82d1-41d6-a21d-bf9899c51813 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:55.769447 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-f7204794-82d1-41d6-a21d-bf9899c51813 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3" status: 200 len: 1731 microversion: 2.20 time: 0.158456 Jul 15 20:46:55.770006 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 524/1046] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:46:55 2022] GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:46:56.789159 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-ca748b7c-610c-4582-9948-1704e77a122c tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:46:56.790013 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-ca748b7c-610c-4582-9948-1704e77a122c tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 39e785be-449f-47ab-9327-8b6a91f7d4c3] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:46:56.796846 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-ca748b7c-610c-4582-9948-1704e77a122c tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:56.797325 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-ca748b7c-610c-4582-9948-1704e77a122c tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:56.798092 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-ca748b7c-610c-4582-9948-1704e77a122c tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:56.798531 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-ca748b7c-610c-4582-9948-1704e77a122c tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:56.929401 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-ca748b7c-610c-4582-9948-1704e77a122c tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:56.938154 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-ca748b7c-610c-4582-9948-1704e77a122c tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:56.939668 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-ca748b7c-610c-4582-9948-1704e77a122c tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:56.940853 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-ca748b7c-610c-4582-9948-1704e77a122c tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3" status: 200 len: 1731 microversion: 2.20 time: 0.156721 Jul 15 20:46:56.941415 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 523/1047] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:46:56 2022] GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:46:57.959170 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-d079cec7-c47d-4fe7-bb7e-5759cfe96b62 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:46:57.959773 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-d079cec7-c47d-4fe7-bb7e-5759cfe96b62 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 39e785be-449f-47ab-9327-8b6a91f7d4c3] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:46:57.966479 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d079cec7-c47d-4fe7-bb7e-5759cfe96b62 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:57.967045 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d079cec7-c47d-4fe7-bb7e-5759cfe96b62 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:57.968656 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d079cec7-c47d-4fe7-bb7e-5759cfe96b62 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:46:57.969110 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d079cec7-c47d-4fe7-bb7e-5759cfe96b62 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:46:58.098692 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-d079cec7-c47d-4fe7-bb7e-5759cfe96b62 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:58.106608 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-d079cec7-c47d-4fe7-bb7e-5759cfe96b62 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:58.108209 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-d079cec7-c47d-4fe7-bb7e-5759cfe96b62 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:46:58.109383 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-d079cec7-c47d-4fe7-bb7e-5759cfe96b62 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3" status: 200 len: 1718 microversion: 2.20 time: 0.154188 Jul 15 20:46:58.109939 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 525/1048] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:46:57 2022] GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3 => generated 1718 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 20:47:12.198854 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-5c4517f1-ef3d-42b8-b555-713b6feedb89 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:47:12.199401 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-5c4517f1-ef3d-42b8-b555-713b6feedb89 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] [instance: 2285aca5-babb-4433-9939-b29a56721716] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:47:12.202456 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_api:SELECT=13 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:47:12.203279 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=59,nova_cell1:UPDATE=3 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:47:12.208826 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-5c4517f1-ef3d-42b8-b555-713b6feedb89 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:47:12.209269 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-5c4517f1-ef3d-42b8-b555-713b6feedb89 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:47:12.210022 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-5c4517f1-ef3d-42b8-b555-713b6feedb89 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:47:12.210457 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-5c4517f1-ef3d-42b8-b555-713b6feedb89 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:47:12.236058 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-5c4517f1-ef3d-42b8-b555-713b6feedb89 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] [instance: 2285aca5-babb-4433-9939-b29a56721716] Going to try to terminate instance {{(pid=124430) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 20:47:12.310032 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-5c4517f1-ef3d-42b8-b555-713b6feedb89 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] 10.222.0.66 "DELETE /compute/v2.1/servers/2285aca5-babb-4433-9939-b29a56721716" status: 204 len: 0 microversion: 2.1 time: 0.114782 Jul 15 20:47:12.310603 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 524/1049] 10.222.0.66 () {58 vars in 1238 bytes} [Fri Jul 15 20:47:12 2022] DELETE /compute/v2.1/servers/2285aca5-babb-4433-9939-b29a56721716 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 20:47:12.318683 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-d271439d-a2b4-4608-b1f4-d8dac4f9c2c6 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:47:12.319306 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-d271439d-a2b4-4608-b1f4-d8dac4f9c2c6 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] [instance: 2285aca5-babb-4433-9939-b29a56721716] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:47:12.321498 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_api:SELECT=15 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:47:12.322143 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell1:SELECT=53 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:47:12.328907 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d271439d-a2b4-4608-b1f4-d8dac4f9c2c6 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:47:12.329347 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d271439d-a2b4-4608-b1f4-d8dac4f9c2c6 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:47:12.330110 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d271439d-a2b4-4608-b1f4-d8dac4f9c2c6 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:47:12.330536 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d271439d-a2b4-4608-b1f4-d8dac4f9c2c6 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:47:12.461116 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-d271439d-a2b4-4608-b1f4-d8dac4f9c2c6 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5f88b90c3b43439d4f3f9b3dc63fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c09076eac534571bd221e2cc5872fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:47:12.469243 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-d271439d-a2b4-4608-b1f4-d8dac4f9c2c6 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] 10.222.0.66 "GET /compute/v2.1/servers/2285aca5-babb-4433-9939-b29a56721716" status: 200 len: 1577 microversion: 2.1 time: 0.154301 Jul 15 20:47:12.469815 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 526/1050] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:47:12 2022] GET /compute/v2.1/servers/2285aca5-babb-4433-9939-b29a56721716 => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:47:13.486209 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-4f9a4e5c-d9e1-45d3-9cfd-f489e301e0da tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:47:13.486904 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-4f9a4e5c-d9e1-45d3-9cfd-f489e301e0da tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] [instance: 2285aca5-babb-4433-9939-b29a56721716] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:47:13.493374 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-4f9a4e5c-d9e1-45d3-9cfd-f489e301e0da tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:47:13.493816 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-4f9a4e5c-d9e1-45d3-9cfd-f489e301e0da tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:47:13.494570 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-4f9a4e5c-d9e1-45d3-9cfd-f489e301e0da tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:47:13.495002 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-4f9a4e5c-d9e1-45d3-9cfd-f489e301e0da tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:47:13.622089 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-4f9a4e5c-d9e1-45d3-9cfd-f489e301e0da tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5f88b90c3b43439d4f3f9b3dc63fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c09076eac534571bd221e2cc5872fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:47:13.630242 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-4f9a4e5c-d9e1-45d3-9cfd-f489e301e0da tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] 10.222.0.66 "GET /compute/v2.1/servers/2285aca5-babb-4433-9939-b29a56721716" status: 200 len: 1577 microversion: 2.1 time: 0.148298 Jul 15 20:47:13.630799 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 525/1051] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:47:13 2022] GET /compute/v2.1/servers/2285aca5-babb-4433-9939-b29a56721716 => generated 1577 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:47:14.647186 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-36c03489-5962-4236-92d1-b891e67d99ad tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:47:14.647797 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-36c03489-5962-4236-92d1-b891e67d99ad tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] [instance: 2285aca5-babb-4433-9939-b29a56721716] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:47:14.654562 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-36c03489-5962-4236-92d1-b891e67d99ad tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:47:14.655616 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-36c03489-5962-4236-92d1-b891e67d99ad tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:47:14.656404 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-36c03489-5962-4236-92d1-b891e67d99ad tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:47:14.656844 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-36c03489-5962-4236-92d1-b891e67d99ad tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:47:14.728895 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-36c03489-5962-4236-92d1-b891e67d99ad tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5f88b90c3b43439d4f3f9b3dc63fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c09076eac534571bd221e2cc5872fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:47:14.737011 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-36c03489-5962-4236-92d1-b891e67d99ad tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] 10.222.0.66 "GET /compute/v2.1/servers/2285aca5-babb-4433-9939-b29a56721716" status: 200 len: 1510 microversion: 2.1 time: 0.093643 Jul 15 20:47:14.737597 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 527/1052] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:47:14 2022] GET /compute/v2.1/servers/2285aca5-babb-4433-9939-b29a56721716 => generated 1510 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:47:14.961028 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [req-2dc38153-263f-4582-b373-87ba4f7bfdd5 req-dc8869d8-9d3d-4d7e-8317-d62369bac030 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2285aca5-babb-4433-9939-b29a56721716", "name": "network-vif-deleted", "tag": "c91f20dd-0fb2-4ca5-bf0f-2fab8dd705da"}]} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:47:14.971294 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-2dc38153-263f-4582-b373-87ba4f7bfdd5 req-dc8869d8-9d3d-4d7e-8317-d62369bac030 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:47:14.971765 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-2dc38153-263f-4582-b373-87ba4f7bfdd5 req-dc8869d8-9d3d-4d7e-8317-d62369bac030 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:47:14.983921 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.compute.server_external_events [req-2dc38153-263f-4582-b373-87ba4f7bfdd5 req-dc8869d8-9d3d-4d7e-8317-d62369bac030 service nova] Creating event network-vif-deleted:c91f20dd-0fb2-4ca5-bf0f-2fab8dd705da for instance 2285aca5-babb-4433-9939-b29a56721716 on hv-cinder-79987 Jul 15 20:47:14.991275 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [req-2dc38153-263f-4582-b373-87ba4f7bfdd5 req-dc8869d8-9d3d-4d7e-8317-d62369bac030 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033423 Jul 15 20:47:14.993608 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 526/1053] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:47:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:47:15.753798 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-43a3fea7-9d33-4b04-8b42-b94b22cad78b tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:47:15.754423 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-43a3fea7-9d33-4b04-8b42-b94b22cad78b tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] [instance: 2285aca5-babb-4433-9939-b29a56721716] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:47:15.761590 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-43a3fea7-9d33-4b04-8b42-b94b22cad78b tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:47:15.762121 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-43a3fea7-9d33-4b04-8b42-b94b22cad78b tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:47:15.762995 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-43a3fea7-9d33-4b04-8b42-b94b22cad78b tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:47:15.763676 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-43a3fea7-9d33-4b04-8b42-b94b22cad78b tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:47:15.802184 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-43a3fea7-9d33-4b04-8b42-b94b22cad78b tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:47:15.802830 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-43a3fea7-9d33-4b04-8b42-b94b22cad78b tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:47:15.803082 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.objects.instance [None req-43a3fea7-9d33-4b04-8b42-b94b22cad78b tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lazy-loading 'fault' on Instance uuid 2285aca5-babb-4433-9939-b29a56721716 {{(pid=124432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 20:47:16.096339 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-43a3fea7-9d33-4b04-8b42-b94b22cad78b tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5f88b90c3b43439d4f3f9b3dc63fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c09076eac534571bd221e2cc5872fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:47:16.103247 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-43a3fea7-9d33-4b04-8b42-b94b22cad78b tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] 10.222.0.66 "GET /compute/v2.1/servers/2285aca5-babb-4433-9939-b29a56721716" status: 200 len: 1185 microversion: 2.1 time: 0.353605 Jul 15 20:47:16.103810 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 528/1054] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:47:15 2022] GET /compute/v2.1/servers/2285aca5-babb-4433-9939-b29a56721716 => generated 1185 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:47:17.121385 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-b5df4e1b-ae31-47bb-9e32-22dd0fcb08e1 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:47:17.122079 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-b5df4e1b-ae31-47bb-9e32-22dd0fcb08e1 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] [instance: 2285aca5-babb-4433-9939-b29a56721716] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:47:17.128316 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b5df4e1b-ae31-47bb-9e32-22dd0fcb08e1 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:47:17.128790 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b5df4e1b-ae31-47bb-9e32-22dd0fcb08e1 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:47:17.129540 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b5df4e1b-ae31-47bb-9e32-22dd0fcb08e1 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:47:17.129982 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b5df4e1b-ae31-47bb-9e32-22dd0fcb08e1 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:47:17.143237 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.wsgi [None req-b5df4e1b-ae31-47bb-9e32-22dd0fcb08e1 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] HTTP exception thrown: Instance 2285aca5-babb-4433-9939-b29a56721716 could not be found. Jul 15 20:47:17.144843 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-b5df4e1b-ae31-47bb-9e32-22dd0fcb08e1 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Request method failure captured: Jul 15 20:47:17.144843 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: request: GET /compute/v2.1/servers/2285aca5-babb-4433-9939-b29a56721716 HTTP/1.1 Jul 15 20:47:17.144843 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Accept: application/json Jul 15 20:47:17.144843 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Accept-Encoding: identity Jul 15 20:47:17.144843 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Connection: close Jul 15 20:47:17.144843 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Content-Length: 0 Jul 15 20:47:17.144843 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Content-Type: application/json Jul 15 20:47:17.144843 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Host: 10.222.0.66 Jul 15 20:47:17.144843 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Openstack-System-Scope: None Jul 15 20:47:17.144843 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: User-Agent: python-urllib3/1.26.9 Jul 15 20:47:17.144843 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Auth-Token: gAAAAABi0dGy1WB24Z1i5jX6X1HxARoDl7WKJyZLHo6VEk0CASphFJOYTal-MKxbQQSA5d4_fUbjf24G_rbW7I66I0PKEopM8NrzY42NGeGQNDsfK2Z7xbbMX7XHzWdwdDRK-FU34AuWXDvYeMFPdBw19kjqDkRjjnmZdVXJ6ckysMa05KMkDp8 Jul 15 20:47:17.144843 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Domain-Id: None Jul 15 20:47:17.144843 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Domain-Name: None Jul 15 20:47:17.144843 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Identity-Status: Confirmed Jul 15 20:47:17.144843 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Is-Admin-Project: True Jul 15 20:47:17.144843 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Domain-Id: default Jul 15 20:47:17.144843 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Domain-Name: Default Jul 15 20:47:17.144843 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Id: 6c09076eac534571bd221e2cc5872fc6 Jul 15 20:47:17.144843 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Name: tempest-TestVolumeBootPattern-1326544490 Jul 15 20:47:17.144843 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Role: member,reader Jul 15 20:47:17.144843 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Roles: member,reader Jul 15 20:47:17.146510 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6c09076eac534571bd221e2cc5872fc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_6c09076eac534571bd221e2cc5872fc6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6c09076eac534571bd221e2cc5872fc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/6c09076eac534571bd221e2cc5872fc6"}]}] Jul 15 20:47:17.146510 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant: tempest-TestVolumeBootPattern-1326544490 Jul 15 20:47:17.146510 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant-Id: 6c09076eac534571bd221e2cc5872fc6 Jul 15 20:47:17.146510 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant-Name: tempest-TestVolumeBootPattern-1326544490 Jul 15 20:47:17.146510 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User: tempest-TestVolumeBootPattern-1326544490-project Jul 15 20:47:17.146510 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Domain-Id: default Jul 15 20:47:17.146510 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Domain-Name: Default Jul 15 20:47:17.146510 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Id: ce5f88b90c3b43439d4f3f9b3dc63fff Jul 15 20:47:17.146510 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Name: tempest-TestVolumeBootPattern-1326544490-project Jul 15 20:47:17.146510 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: method: > Jul 15 20:47:17.146510 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: exception: Instance 2285aca5-babb-4433-9939-b29a56721716 could not be found. Jul 15 20:47:17.146510 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: action_args: {'id': '2285aca5-babb-4433-9939-b29a56721716'} Jul 15 20:47:17.147657 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 20:47:17.147657 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:47:17.147657 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 20:47:17.147657 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 20:47:17.147657 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 20:47:17.147657 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 20:47:17.147657 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 20:47:17.147657 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 20:47:17.147657 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 20:47:17.147657 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 20:47:17.147657 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2285aca5-babb-4433-9939-b29a56721716 could not be found. Jul 15 20:47:17.147657 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:47:17.147657 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:47:17.147657 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:47:17.147657 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:47:17.147657 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:47:17.147657 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:47:17.147657 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 20:47:17.147657 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 20:47:17.147657 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 20:47:17.149285 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 20:47:17.149285 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 20:47:17.149285 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 20:47:17.149285 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 20:47:17.149285 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 20:47:17.149285 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 20:47:17.149285 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 20:47:17.149285 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2285aca5-babb-4433-9939-b29a56721716 could not be found. Jul 15 20:47:17.149285 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:47:17.149285 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:47:17.149285 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:47:17.149285 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:47:17.149285 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:47:17.149285 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:47:17.149285 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 20:47:17.149285 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 20:47:17.149285 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2285aca5-babb-4433-9939-b29a56721716 could not be found. Jul 15 20:47:17.149285 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:47:17.150707 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-b5df4e1b-ae31-47bb-9e32-22dd0fcb08e1 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Returning 404 to user: Instance 2285aca5-babb-4433-9939-b29a56721716 could not be found. {{(pid=124430) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 20:47:17.150707 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-b5df4e1b-ae31-47bb-9e32-22dd0fcb08e1 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] 10.222.0.66 "GET /compute/v2.1/servers/2285aca5-babb-4433-9939-b29a56721716" status: 404 len: 111 microversion: 2.1 time: 0.029711 Jul 15 20:47:17.150707 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 527/1055] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:47:17 2022] GET /compute/v2.1/servers/2285aca5-babb-4433-9939-b29a56721716 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 20:47:17.242258 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-b308434e-aed8-4420-a88f-32db8fadb7bb tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-687944060", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2104996658", "security_groups": [{"name": "tempest-secgroup-smoke-778498841"}], "block_device_mapping_v2": [{"uuid": "6acfdf69-f7c0-403e-8f46-e8dd425fe18a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "66a9f55c-6da3-47d0-86fe-281ad3b00d29"}]}} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:47:17.350893 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.network.neutron [None req-b308434e-aed8-4420-a88f-32db8fadb7bb tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] validate_networks() for [('66a9f55c-6da3-47d0-86fe-281ad3b00d29', None, None, None, None, None)] {{(pid=124432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 20:47:17.758480 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-b308434e-aed8-4420-a88f-32db8fadb7bb tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Flavor limits 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 20:47:17.758906 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-b308434e-aed8-4420-a88f-32db8fadb7bb tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Image limits 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 20:47:17.759383 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-b308434e-aed8-4420-a88f-32db8fadb7bb tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Flavor pref 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 20:47:17.760057 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-b308434e-aed8-4420-a88f-32db8fadb7bb tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Image pref 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 20:47:17.760520 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-b308434e-aed8-4420-a88f-32db8fadb7bb tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 20:47:17.770257 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b308434e-aed8-4420-a88f-32db8fadb7bb tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:47:17.770707 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b308434e-aed8-4420-a88f-32db8fadb7bb tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:47:17.771507 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b308434e-aed8-4420-a88f-32db8fadb7bb tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:47:17.771941 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b308434e-aed8-4420-a88f-32db8fadb7bb tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:47:17.788436 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-b308434e-aed8-4420-a88f-32db8fadb7bb tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Getting quotas for project 6c09076eac534571bd221e2cc5872fc6. Resources: {'instances', 'ram', 'cores'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 20:47:17.792501 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-b308434e-aed8-4420-a88f-32db8fadb7bb tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Getting quotas for user ce5f88b90c3b43439d4f3f9b3dc63fff and project 6c09076eac534571bd221e2cc5872fc6. Resources: {'instances', 'ram', 'cores'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 20:47:17.849783 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-b308434e-aed8-4420-a88f-32db8fadb7bb tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Going to run 1 instances... {{(pid=124432) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 20:47:17.851838 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-b308434e-aed8-4420-a88f-32db8fadb7bb tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] [instance: 9293b8fc-2bf0-481f-ac99-e06e586fcb5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6acfdf69-f7c0-403e-8f46-e8dd425fe18a',volume_size=None,volume_type=None)] {{(pid=124432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 20:47:17.975858 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-b308434e-aed8-4420-a88f-32db8fadb7bb tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.737530 Jul 15 20:47:17.976537 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 529/1056] 10.222.0.66 () {60 vars in 1146 bytes} [Fri Jul 15 20:47:17 2022] POST /compute/v2.1/servers => generated 405 bytes in 739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 20:47:17.986346 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-c5080843-8301-480a-8612-26f141fe19e9 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:47:17.987045 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-c5080843-8301-480a-8612-26f141fe19e9 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] [instance: 9293b8fc-2bf0-481f-ac99-e06e586fcb5d] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:47:18.041494 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-c5080843-8301-480a-8612-26f141fe19e9 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5f88b90c3b43439d4f3f9b3dc63fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c09076eac534571bd221e2cc5872fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:47:18.048303 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-c5080843-8301-480a-8612-26f141fe19e9 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] 10.222.0.66 "GET /compute/v2.1/servers/9293b8fc-2bf0-481f-ac99-e06e586fcb5d" status: 200 len: 1094 microversion: 2.1 time: 0.065832 Jul 15 20:47:18.048892 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 528/1057] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:47:17 2022] GET /compute/v2.1/servers/9293b8fc-2bf0-481f-ac99-e06e586fcb5d => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:47:19.066352 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-aa3685c8-6f8c-484a-9027-7a96c18240f8 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:47:19.067062 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-aa3685c8-6f8c-484a-9027-7a96c18240f8 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] [instance: 9293b8fc-2bf0-481f-ac99-e06e586fcb5d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:47:19.074440 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-aa3685c8-6f8c-484a-9027-7a96c18240f8 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:47:19.074970 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-aa3685c8-6f8c-484a-9027-7a96c18240f8 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:47:19.075813 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-aa3685c8-6f8c-484a-9027-7a96c18240f8 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:47:19.076257 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-aa3685c8-6f8c-484a-9027-7a96c18240f8 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:47:19.148895 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-aa3685c8-6f8c-484a-9027-7a96c18240f8 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5f88b90c3b43439d4f3f9b3dc63fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c09076eac534571bd221e2cc5872fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:47:19.157234 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-aa3685c8-6f8c-484a-9027-7a96c18240f8 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] 10.222.0.66 "GET /compute/v2.1/servers/9293b8fc-2bf0-481f-ac99-e06e586fcb5d" status: 200 len: 1210 microversion: 2.1 time: 0.096084 Jul 15 20:47:19.157977 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 530/1058] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:47:19 2022] GET /compute/v2.1/servers/9293b8fc-2bf0-481f-ac99-e06e586fcb5d => generated 1210 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:47:20.174539 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-e4eeec76-bc81-4007-8765-722df9bcd406 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:47:20.175793 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-e4eeec76-bc81-4007-8765-722df9bcd406 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] [instance: 9293b8fc-2bf0-481f-ac99-e06e586fcb5d] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:47:20.183111 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e4eeec76-bc81-4007-8765-722df9bcd406 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:47:20.183489 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e4eeec76-bc81-4007-8765-722df9bcd406 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:47:20.184267 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e4eeec76-bc81-4007-8765-722df9bcd406 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:47:20.185031 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e4eeec76-bc81-4007-8765-722df9bcd406 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:47:20.330200 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-e4eeec76-bc81-4007-8765-722df9bcd406 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5f88b90c3b43439d4f3f9b3dc63fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c09076eac534571bd221e2cc5872fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:47:20.338654 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-e4eeec76-bc81-4007-8765-722df9bcd406 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] 10.222.0.66 "GET /compute/v2.1/servers/9293b8fc-2bf0-481f-ac99-e06e586fcb5d" status: 200 len: 1265 microversion: 2.1 time: 0.168452 Jul 15 20:47:20.339749 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 529/1059] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:47:20 2022] GET /compute/v2.1/servers/9293b8fc-2bf0-481f-ac99-e06e586fcb5d => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:47:20.410160 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-ada20f2e-d4bb-4a61-8661-5cc769ab836f req-040fe25e-c316-4713-9bd0-7a7d7484dff5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9293b8fc-2bf0-481f-ac99-e06e586fcb5d", "tag": "f2037b81-737e-4a90-bc77-00e0442b9d7a"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:47:20.423757 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-ada20f2e-d4bb-4a61-8661-5cc769ab836f req-040fe25e-c316-4713-9bd0-7a7d7484dff5 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:47:20.424284 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-ada20f2e-d4bb-4a61-8661-5cc769ab836f req-040fe25e-c316-4713-9bd0-7a7d7484dff5 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:47:20.435854 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-ada20f2e-d4bb-4a61-8661-5cc769ab836f req-040fe25e-c316-4713-9bd0-7a7d7484dff5 service nova] Creating event network-changed:f2037b81-737e-4a90-bc77-00e0442b9d7a for instance 9293b8fc-2bf0-481f-ac99-e06e586fcb5d on hv-cinder-79987 Jul 15 20:47:20.441954 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-ada20f2e-d4bb-4a61-8661-5cc769ab836f req-040fe25e-c316-4713-9bd0-7a7d7484dff5 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035153 Jul 15 20:47:20.442782 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 531/1060] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:47:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:47:21.356558 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-522053ed-b38e-48fa-9d7d-61a2aeea8b00 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:47:21.357218 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-522053ed-b38e-48fa-9d7d-61a2aeea8b00 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] [instance: 9293b8fc-2bf0-481f-ac99-e06e586fcb5d] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:47:21.363251 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-522053ed-b38e-48fa-9d7d-61a2aeea8b00 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:47:21.363703 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-522053ed-b38e-48fa-9d7d-61a2aeea8b00 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:47:21.364491 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-522053ed-b38e-48fa-9d7d-61a2aeea8b00 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:47:21.364924 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-522053ed-b38e-48fa-9d7d-61a2aeea8b00 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:47:21.497597 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-522053ed-b38e-48fa-9d7d-61a2aeea8b00 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5f88b90c3b43439d4f3f9b3dc63fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c09076eac534571bd221e2cc5872fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:47:21.505736 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-522053ed-b38e-48fa-9d7d-61a2aeea8b00 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] 10.222.0.66 "GET /compute/v2.1/servers/9293b8fc-2bf0-481f-ac99-e06e586fcb5d" status: 200 len: 1265 microversion: 2.1 time: 0.153284 Jul 15 20:47:21.506293 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 530/1061] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:47:21 2022] GET /compute/v2.1/servers/9293b8fc-2bf0-481f-ac99-e06e586fcb5d => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:47:22.524763 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-dd59f390-5c32-413d-90c0-74b32846ae6b tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:47:22.525475 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-dd59f390-5c32-413d-90c0-74b32846ae6b tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] [instance: 9293b8fc-2bf0-481f-ac99-e06e586fcb5d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:47:22.532249 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-dd59f390-5c32-413d-90c0-74b32846ae6b tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:47:22.532723 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-dd59f390-5c32-413d-90c0-74b32846ae6b tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:47:22.533487 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-dd59f390-5c32-413d-90c0-74b32846ae6b tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:47:22.533923 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-dd59f390-5c32-413d-90c0-74b32846ae6b tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:47:22.668757 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-dd59f390-5c32-413d-90c0-74b32846ae6b tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5f88b90c3b43439d4f3f9b3dc63fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c09076eac534571bd221e2cc5872fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:47:22.676211 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-dd59f390-5c32-413d-90c0-74b32846ae6b tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] 10.222.0.66 "GET /compute/v2.1/servers/9293b8fc-2bf0-481f-ac99-e06e586fcb5d" status: 200 len: 1265 microversion: 2.1 time: 0.156096 Jul 15 20:47:22.676809 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 532/1062] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:47:22 2022] GET /compute/v2.1/servers/9293b8fc-2bf0-481f-ac99-e06e586fcb5d => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:47:23.693618 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-3dd1ed33-1bb1-427d-b06b-02020958dc9a tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:47:23.694227 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-3dd1ed33-1bb1-427d-b06b-02020958dc9a tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] [instance: 9293b8fc-2bf0-481f-ac99-e06e586fcb5d] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:47:23.700849 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-3dd1ed33-1bb1-427d-b06b-02020958dc9a tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:47:23.701302 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-3dd1ed33-1bb1-427d-b06b-02020958dc9a tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:47:23.702743 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-3dd1ed33-1bb1-427d-b06b-02020958dc9a tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:47:23.703187 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-3dd1ed33-1bb1-427d-b06b-02020958dc9a tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:47:23.836305 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-3dd1ed33-1bb1-427d-b06b-02020958dc9a tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5f88b90c3b43439d4f3f9b3dc63fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c09076eac534571bd221e2cc5872fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:47:23.844242 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-3dd1ed33-1bb1-427d-b06b-02020958dc9a tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] 10.222.0.66 "GET /compute/v2.1/servers/9293b8fc-2bf0-481f-ac99-e06e586fcb5d" status: 200 len: 1265 microversion: 2.1 time: 0.154523 Jul 15 20:47:23.844838 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 531/1063] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:47:23 2022] GET /compute/v2.1/servers/9293b8fc-2bf0-481f-ac99-e06e586fcb5d => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:47:24.861555 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-626fa878-1082-4cab-a094-6f923fc75022 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:47:24.862095 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-626fa878-1082-4cab-a094-6f923fc75022 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] [instance: 9293b8fc-2bf0-481f-ac99-e06e586fcb5d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:47:24.868621 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-626fa878-1082-4cab-a094-6f923fc75022 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:47:24.869066 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-626fa878-1082-4cab-a094-6f923fc75022 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:47:24.869818 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-626fa878-1082-4cab-a094-6f923fc75022 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:47:24.870247 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-626fa878-1082-4cab-a094-6f923fc75022 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:47:25.007466 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-626fa878-1082-4cab-a094-6f923fc75022 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5f88b90c3b43439d4f3f9b3dc63fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c09076eac534571bd221e2cc5872fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:47:25.015419 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-626fa878-1082-4cab-a094-6f923fc75022 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] 10.222.0.66 "GET /compute/v2.1/servers/9293b8fc-2bf0-481f-ac99-e06e586fcb5d" status: 200 len: 1265 microversion: 2.1 time: 0.158316 Jul 15 20:47:25.015984 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 533/1064] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:47:24 2022] GET /compute/v2.1/servers/9293b8fc-2bf0-481f-ac99-e06e586fcb5d => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:47:26.032433 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-b16d550d-918a-4020-9498-11b5355cf48f tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:47:26.033082 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-b16d550d-918a-4020-9498-11b5355cf48f tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] [instance: 9293b8fc-2bf0-481f-ac99-e06e586fcb5d] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:47:26.040325 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b16d550d-918a-4020-9498-11b5355cf48f tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:47:26.041050 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b16d550d-918a-4020-9498-11b5355cf48f tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:47:26.041865 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b16d550d-918a-4020-9498-11b5355cf48f tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:47:26.042924 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b16d550d-918a-4020-9498-11b5355cf48f tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:47:26.173539 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-b16d550d-918a-4020-9498-11b5355cf48f tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5f88b90c3b43439d4f3f9b3dc63fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c09076eac534571bd221e2cc5872fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:47:26.181089 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-b16d550d-918a-4020-9498-11b5355cf48f tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] 10.222.0.66 "GET /compute/v2.1/servers/9293b8fc-2bf0-481f-ac99-e06e586fcb5d" status: 200 len: 1265 microversion: 2.1 time: 0.152987 Jul 15 20:47:26.181651 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 532/1065] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:47:26 2022] GET /compute/v2.1/servers/9293b8fc-2bf0-481f-ac99-e06e586fcb5d => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:47:27.198391 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-ef785fe7-6905-425d-b783-0386ad940ae2 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:47:27.198993 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-ef785fe7-6905-425d-b783-0386ad940ae2 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] [instance: 9293b8fc-2bf0-481f-ac99-e06e586fcb5d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:47:27.206555 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ef785fe7-6905-425d-b783-0386ad940ae2 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:47:27.207003 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ef785fe7-6905-425d-b783-0386ad940ae2 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:47:27.207754 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ef785fe7-6905-425d-b783-0386ad940ae2 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:47:27.208180 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ef785fe7-6905-425d-b783-0386ad940ae2 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:47:27.339148 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-ef785fe7-6905-425d-b783-0386ad940ae2 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5f88b90c3b43439d4f3f9b3dc63fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c09076eac534571bd221e2cc5872fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:47:27.347040 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-ef785fe7-6905-425d-b783-0386ad940ae2 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] 10.222.0.66 "GET /compute/v2.1/servers/9293b8fc-2bf0-481f-ac99-e06e586fcb5d" status: 200 len: 1265 microversion: 2.1 time: 0.152519 Jul 15 20:47:27.347607 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 534/1066] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:47:27 2022] GET /compute/v2.1/servers/9293b8fc-2bf0-481f-ac99-e06e586fcb5d => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:47:28.364258 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-54be150a-58e5-45e7-9611-2c918cb5bd51 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:47:28.364898 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-54be150a-58e5-45e7-9611-2c918cb5bd51 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] [instance: 9293b8fc-2bf0-481f-ac99-e06e586fcb5d] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:47:28.367284 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_cell0:SELECT=2 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:47:28.372450 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-54be150a-58e5-45e7-9611-2c918cb5bd51 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:47:28.372894 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-54be150a-58e5-45e7-9611-2c918cb5bd51 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:47:28.373643 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-54be150a-58e5-45e7-9611-2c918cb5bd51 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:47:28.374162 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-54be150a-58e5-45e7-9611-2c918cb5bd51 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:47:28.508790 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-54be150a-58e5-45e7-9611-2c918cb5bd51 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5f88b90c3b43439d4f3f9b3dc63fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c09076eac534571bd221e2cc5872fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:47:28.516938 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-54be150a-58e5-45e7-9611-2c918cb5bd51 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] 10.222.0.66 "GET /compute/v2.1/servers/9293b8fc-2bf0-481f-ac99-e06e586fcb5d" status: 200 len: 1265 microversion: 2.1 time: 0.156561 Jul 15 20:47:28.517495 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 533/1067] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:47:28 2022] GET /compute/v2.1/servers/9293b8fc-2bf0-481f-ac99-e06e586fcb5d => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:47:29.533983 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-4c52fb16-5b30-40c3-91ff-ddd02ab3a996 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:47:29.534600 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-4c52fb16-5b30-40c3-91ff-ddd02ab3a996 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] [instance: 9293b8fc-2bf0-481f-ac99-e06e586fcb5d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:47:29.536614 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell0:SELECT=2 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:47:29.537485 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell0:SELECT=6 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:47:29.544781 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4c52fb16-5b30-40c3-91ff-ddd02ab3a996 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:47:29.545231 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4c52fb16-5b30-40c3-91ff-ddd02ab3a996 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:47:29.546529 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4c52fb16-5b30-40c3-91ff-ddd02ab3a996 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:47:29.546962 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4c52fb16-5b30-40c3-91ff-ddd02ab3a996 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:47:29.689318 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-4c52fb16-5b30-40c3-91ff-ddd02ab3a996 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5f88b90c3b43439d4f3f9b3dc63fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c09076eac534571bd221e2cc5872fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:47:29.697177 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-4c52fb16-5b30-40c3-91ff-ddd02ab3a996 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] 10.222.0.66 "GET /compute/v2.1/servers/9293b8fc-2bf0-481f-ac99-e06e586fcb5d" status: 200 len: 1265 microversion: 2.1 time: 0.167270 Jul 15 20:47:29.697753 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 535/1068] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:47:29 2022] GET /compute/v2.1/servers/9293b8fc-2bf0-481f-ac99-e06e586fcb5d => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:47:30.714286 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-e1a61b72-1125-441b-a18c-9c3b86bbb641 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:47:30.714828 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-e1a61b72-1125-441b-a18c-9c3b86bbb641 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] [instance: 9293b8fc-2bf0-481f-ac99-e06e586fcb5d] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:47:30.721908 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e1a61b72-1125-441b-a18c-9c3b86bbb641 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:47:30.722360 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e1a61b72-1125-441b-a18c-9c3b86bbb641 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:47:30.723120 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e1a61b72-1125-441b-a18c-9c3b86bbb641 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:47:30.723557 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e1a61b72-1125-441b-a18c-9c3b86bbb641 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:47:30.855444 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-e1a61b72-1125-441b-a18c-9c3b86bbb641 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5f88b90c3b43439d4f3f9b3dc63fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c09076eac534571bd221e2cc5872fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:47:30.863580 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-e1a61b72-1125-441b-a18c-9c3b86bbb641 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] 10.222.0.66 "GET /compute/v2.1/servers/9293b8fc-2bf0-481f-ac99-e06e586fcb5d" status: 200 len: 1265 microversion: 2.1 time: 0.153293 Jul 15 20:47:30.864131 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 534/1069] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:47:30 2022] GET /compute/v2.1/servers/9293b8fc-2bf0-481f-ac99-e06e586fcb5d => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:47:31.257636 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-fdd60646-13a9-4247-b1f4-a40c58b52e5e tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:47:31.258559 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-fdd60646-13a9-4247-b1f4-a40c58b52e5e tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 39e785be-449f-47ab-9327-8b6a91f7d4c3] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:47:31.265752 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fdd60646-13a9-4247-b1f4-a40c58b52e5e tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:47:31.266201 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fdd60646-13a9-4247-b1f4-a40c58b52e5e tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:47:31.266963 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fdd60646-13a9-4247-b1f4-a40c58b52e5e tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:47:31.267398 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fdd60646-13a9-4247-b1f4-a40c58b52e5e tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:47:31.295540 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-fdd60646-13a9-4247-b1f4-a40c58b52e5e tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041902 Jul 15 20:47:31.296094 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 536/1070] 10.222.0.66 () {60 vars in 1342 bytes} [Fri Jul 15 20:47:31 2022] GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:47:31.352815 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-c6a03e9a-9922-4a08-a82f-bda0212381f0 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:47:31.353301 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-c6a03e9a-9922-4a08-a82f-bda0212381f0 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 39e785be-449f-47ab-9327-8b6a91f7d4c3] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:47:31.359206 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c6a03e9a-9922-4a08-a82f-bda0212381f0 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:47:31.359639 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c6a03e9a-9922-4a08-a82f-bda0212381f0 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:47:31.360410 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c6a03e9a-9922-4a08-a82f-bda0212381f0 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:47:31.360840 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c6a03e9a-9922-4a08-a82f-bda0212381f0 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:47:31.385127 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-c6a03e9a-9922-4a08-a82f-bda0212381f0 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 39e785be-449f-47ab-9327-8b6a91f7d4c3] Going to try to terminate instance {{(pid=124430) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 20:47:31.467855 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-c6a03e9a-9922-4a08-a82f-bda0212381f0 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "DELETE /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3" status: 204 len: 0 microversion: 2.20 time: 0.118351 Jul 15 20:47:31.468332 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 535/1071] 10.222.0.66 () {60 vars in 1279 bytes} [Fri Jul 15 20:47:31 2022] DELETE /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 15 20:47:31.476897 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-f9385561-2a1e-4ff9-bf0b-a9797c753eed tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:47:31.477542 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-f9385561-2a1e-4ff9-bf0b-a9797c753eed tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 39e785be-449f-47ab-9327-8b6a91f7d4c3] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:47:31.484119 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f9385561-2a1e-4ff9-bf0b-a9797c753eed tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:47:31.484607 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f9385561-2a1e-4ff9-bf0b-a9797c753eed tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:47:31.485381 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f9385561-2a1e-4ff9-bf0b-a9797c753eed tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:47:31.485817 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f9385561-2a1e-4ff9-bf0b-a9797c753eed tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:47:31.618295 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-f9385561-2a1e-4ff9-bf0b-a9797c753eed tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:47:31.627287 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-f9385561-2a1e-4ff9-bf0b-a9797c753eed tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:47:31.628812 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-f9385561-2a1e-4ff9-bf0b-a9797c753eed tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:47:31.629976 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-f9385561-2a1e-4ff9-bf0b-a9797c753eed tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3" status: 200 len: 1724 microversion: 2.20 time: 0.157368 Jul 15 20:47:31.630532 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 537/1072] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:47:31 2022] GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:47:31.691026 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [req-90d178dd-c5be-4483-b949-70eb5013781f req-682b4fe9-ba28-4a4a-9abd-66c85d511399 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9293b8fc-2bf0-481f-ac99-e06e586fcb5d", "name": "network-vif-plugged", "status": "completed", "tag": "f2037b81-737e-4a90-bc77-00e0442b9d7a"}]} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:47:31.699722 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-90d178dd-c5be-4483-b949-70eb5013781f req-682b4fe9-ba28-4a4a-9abd-66c85d511399 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:47:31.700168 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-90d178dd-c5be-4483-b949-70eb5013781f req-682b4fe9-ba28-4a4a-9abd-66c85d511399 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:47:31.712022 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.compute.server_external_events [req-90d178dd-c5be-4483-b949-70eb5013781f req-682b4fe9-ba28-4a4a-9abd-66c85d511399 service nova] Creating event network-vif-plugged:f2037b81-737e-4a90-bc77-00e0442b9d7a for instance 9293b8fc-2bf0-481f-ac99-e06e586fcb5d on hv-cinder-79987 Jul 15 20:47:31.716738 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [req-90d178dd-c5be-4483-b949-70eb5013781f req-682b4fe9-ba28-4a4a-9abd-66c85d511399 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030333 Jul 15 20:47:31.717699 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 536/1073] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:47:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:47:31.880749 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-9908492d-e1b7-4b9e-8e0d-d9e8d9f2e73b tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:47:31.881332 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-9908492d-e1b7-4b9e-8e0d-d9e8d9f2e73b tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] [instance: 9293b8fc-2bf0-481f-ac99-e06e586fcb5d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:47:31.887439 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9908492d-e1b7-4b9e-8e0d-d9e8d9f2e73b tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:47:31.887877 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9908492d-e1b7-4b9e-8e0d-d9e8d9f2e73b tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:47:31.888648 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9908492d-e1b7-4b9e-8e0d-d9e8d9f2e73b tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:47:31.889107 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9908492d-e1b7-4b9e-8e0d-d9e8d9f2e73b tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:47:32.017774 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-9908492d-e1b7-4b9e-8e0d-d9e8d9f2e73b tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5f88b90c3b43439d4f3f9b3dc63fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c09076eac534571bd221e2cc5872fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:47:32.025149 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-9908492d-e1b7-4b9e-8e0d-d9e8d9f2e73b tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] 10.222.0.66 "GET /compute/v2.1/servers/9293b8fc-2bf0-481f-ac99-e06e586fcb5d" status: 200 len: 1265 microversion: 2.1 time: 0.148207 Jul 15 20:47:32.025704 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 538/1074] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:47:31 2022] GET /compute/v2.1/servers/9293b8fc-2bf0-481f-ac99-e06e586fcb5d => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:47:32.649767 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-5dc28d5f-aec2-4e90-a70c-7c6e6fa69fcd tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:47:32.650530 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-5dc28d5f-aec2-4e90-a70c-7c6e6fa69fcd tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 39e785be-449f-47ab-9327-8b6a91f7d4c3] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:47:32.657429 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-5dc28d5f-aec2-4e90-a70c-7c6e6fa69fcd tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:47:32.657878 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-5dc28d5f-aec2-4e90-a70c-7c6e6fa69fcd tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:47:32.658646 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-5dc28d5f-aec2-4e90-a70c-7c6e6fa69fcd tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:47:32.659082 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-5dc28d5f-aec2-4e90-a70c-7c6e6fa69fcd tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:47:32.802171 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-5dc28d5f-aec2-4e90-a70c-7c6e6fa69fcd tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:47:32.810887 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-5dc28d5f-aec2-4e90-a70c-7c6e6fa69fcd tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:47:32.812790 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-5dc28d5f-aec2-4e90-a70c-7c6e6fa69fcd tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:47:32.813938 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-5dc28d5f-aec2-4e90-a70c-7c6e6fa69fcd tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3" status: 200 len: 1724 microversion: 2.20 time: 0.168918 Jul 15 20:47:32.814482 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 537/1075] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:47:32 2022] GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:47:33.042878 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-99832fae-ca66-4237-87df-665c9f3320b0 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:47:33.043688 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-99832fae-ca66-4237-87df-665c9f3320b0 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] [instance: 9293b8fc-2bf0-481f-ac99-e06e586fcb5d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:47:33.050939 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-99832fae-ca66-4237-87df-665c9f3320b0 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:47:33.051383 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-99832fae-ca66-4237-87df-665c9f3320b0 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:47:33.052136 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-99832fae-ca66-4237-87df-665c9f3320b0 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:47:33.052595 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-99832fae-ca66-4237-87df-665c9f3320b0 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:47:33.180549 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-99832fae-ca66-4237-87df-665c9f3320b0 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5f88b90c3b43439d4f3f9b3dc63fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c09076eac534571bd221e2cc5872fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:47:33.187927 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-99832fae-ca66-4237-87df-665c9f3320b0 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] 10.222.0.66 "GET /compute/v2.1/servers/9293b8fc-2bf0-481f-ac99-e06e586fcb5d" status: 200 len: 1265 microversion: 2.1 time: 0.148971 Jul 15 20:47:33.188506 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 539/1076] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:47:33 2022] GET /compute/v2.1/servers/9293b8fc-2bf0-481f-ac99-e06e586fcb5d => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:47:33.832119 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-05d50961-a9e3-4f83-bb6d-f79863d92e02 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:47:33.832731 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-05d50961-a9e3-4f83-bb6d-f79863d92e02 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 39e785be-449f-47ab-9327-8b6a91f7d4c3] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:47:33.839331 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-05d50961-a9e3-4f83-bb6d-f79863d92e02 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:47:33.839773 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-05d50961-a9e3-4f83-bb6d-f79863d92e02 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:47:33.840562 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-05d50961-a9e3-4f83-bb6d-f79863d92e02 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:47:33.840996 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-05d50961-a9e3-4f83-bb6d-f79863d92e02 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:47:33.908725 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-05d50961-a9e3-4f83-bb6d-f79863d92e02 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:47:33.917087 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-05d50961-a9e3-4f83-bb6d-f79863d92e02 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:47:33.918850 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-05d50961-a9e3-4f83-bb6d-f79863d92e02 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe7070e9384403ca998a996e8dd6b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852483a41394ef699c09ccee827fa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:47:33.920054 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-05d50961-a9e3-4f83-bb6d-f79863d92e02 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3" status: 200 len: 1656 microversion: 2.20 time: 0.091794 Jul 15 20:47:33.920631 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 538/1077] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:47:33 2022] GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3 => generated 1656 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 20:47:34.205864 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-359f4f30-8fc4-4083-bfc9-a43001e481fc tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:47:34.206542 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-359f4f30-8fc4-4083-bfc9-a43001e481fc tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] [instance: 9293b8fc-2bf0-481f-ac99-e06e586fcb5d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:47:34.213250 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-359f4f30-8fc4-4083-bfc9-a43001e481fc tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:47:34.213891 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-359f4f30-8fc4-4083-bfc9-a43001e481fc tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:47:34.214665 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-359f4f30-8fc4-4083-bfc9-a43001e481fc tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:47:34.215326 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-359f4f30-8fc4-4083-bfc9-a43001e481fc tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:47:34.283136 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [req-914918b9-e259-474f-a8f1-e872bd9af329 req-2b4f5c37-f5cb-47be-a81f-91f3c4cc183d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39e785be-449f-47ab-9327-8b6a91f7d4c3", "name": "network-vif-deleted", "tag": "ba9974a7-bd5a-4107-add7-f41006769a31"}]} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:47:34.291792 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-914918b9-e259-474f-a8f1-e872bd9af329 req-2b4f5c37-f5cb-47be-a81f-91f3c4cc183d service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:47:34.292618 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-914918b9-e259-474f-a8f1-e872bd9af329 req-2b4f5c37-f5cb-47be-a81f-91f3c4cc183d service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:47:34.309052 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.compute.server_external_events [req-914918b9-e259-474f-a8f1-e872bd9af329 req-2b4f5c37-f5cb-47be-a81f-91f3c4cc183d service nova] Creating event network-vif-deleted:ba9974a7-bd5a-4107-add7-f41006769a31 for instance 39e785be-449f-47ab-9327-8b6a91f7d4c3 on hv-cinder-79987 Jul 15 20:47:34.314733 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [req-914918b9-e259-474f-a8f1-e872bd9af329 req-2b4f5c37-f5cb-47be-a81f-91f3c4cc183d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111467 Jul 15 20:47:34.315516 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 539/1078] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:47:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:47:34.396294 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-359f4f30-8fc4-4083-bfc9-a43001e481fc tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5f88b90c3b43439d4f3f9b3dc63fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c09076eac534571bd221e2cc5872fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:47:34.406596 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-359f4f30-8fc4-4083-bfc9-a43001e481fc tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] 10.222.0.66 "GET /compute/v2.1/servers/9293b8fc-2bf0-481f-ac99-e06e586fcb5d" status: 200 len: 1265 microversion: 2.1 time: 0.203249 Jul 15 20:47:34.407374 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 540/1079] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:47:34 2022] GET /compute/v2.1/servers/9293b8fc-2bf0-481f-ac99-e06e586fcb5d => generated 1265 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:47:34.939664 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-ebf53e4c-e80a-41bb-a165-ca2c87441957 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:47:34.940455 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-ebf53e4c-e80a-41bb-a165-ca2c87441957 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 39e785be-449f-47ab-9327-8b6a91f7d4c3] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:47:34.946993 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-ebf53e4c-e80a-41bb-a165-ca2c87441957 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:47:34.947441 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-ebf53e4c-e80a-41bb-a165-ca2c87441957 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:47:34.948211 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-ebf53e4c-e80a-41bb-a165-ca2c87441957 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:47:34.948665 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-ebf53e4c-e80a-41bb-a165-ca2c87441957 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:47:34.961957 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.wsgi [None req-ebf53e4c-e80a-41bb-a165-ca2c87441957 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] HTTP exception thrown: Instance 39e785be-449f-47ab-9327-8b6a91f7d4c3 could not be found. Jul 15 20:47:34.963896 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-ebf53e4c-e80a-41bb-a165-ca2c87441957 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Request method failure captured: Jul 15 20:47:34.963896 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: request: GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3 HTTP/1.1 Jul 15 20:47:34.963896 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Accept: application/json Jul 15 20:47:34.963896 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Accept-Encoding: identity Jul 15 20:47:34.963896 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Connection: close Jul 15 20:47:34.963896 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Content-Length: 0 Jul 15 20:47:34.963896 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Content-Type: application/json Jul 15 20:47:34.963896 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Host: 10.222.0.66 Jul 15 20:47:34.963896 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Openstack-System-Scope: None Jul 15 20:47:34.963896 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: User-Agent: python-urllib3/1.26.9 Jul 15 20:47:34.963896 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Auth-Token: gAAAAABi0dFH_kVmw3XM2IjdbWBHIk7iAsXHabdarxNv4clC7Z6b_TX2DNTWs6HZczbnRUGIwqWChZTwOuYcLMLRL0a1j1H_SaNHcdSWv83qyG1N6BZb2ZfqDMmHNqn-xC38vSrGK9hibvfMLjHFo_ycldhvWSibqI1pbQytko_qiHZAl_ZlM0Y Jul 15 20:47:34.963896 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Domain-Id: None Jul 15 20:47:34.963896 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Domain-Name: None Jul 15 20:47:34.963896 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Identity-Status: Confirmed Jul 15 20:47:34.963896 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Is-Admin-Project: True Jul 15 20:47:34.963896 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Openstack-Nova-Api-Version: 2.20 Jul 15 20:47:34.963896 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Domain-Id: default Jul 15 20:47:34.963896 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Domain-Name: Default Jul 15 20:47:34.963896 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Id: f852483a41394ef699c09ccee827fa28 Jul 15 20:47:34.963896 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2005081688 Jul 15 20:47:34.963896 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Role: member,reader Jul 15 20:47:34.963896 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Roles: member,reader Jul 15 20:47:34.965775 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f852483a41394ef699c09ccee827fa28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f852483a41394ef699c09ccee827fa28"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f852483a41394ef699c09ccee827fa28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f852483a41394ef699c09ccee827fa28"}]}] Jul 15 20:47:34.965775 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2005081688 Jul 15 20:47:34.965775 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant-Id: f852483a41394ef699c09ccee827fa28 Jul 15 20:47:34.965775 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2005081688 Jul 15 20:47:34.965775 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User: tempest-AttachVolumeShelveTestJSON-2005081688-project Jul 15 20:47:34.965775 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Domain-Id: default Jul 15 20:47:34.965775 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Domain-Name: Default Jul 15 20:47:34.965775 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Id: fbe7070e9384403ca998a996e8dd6b50 Jul 15 20:47:34.965775 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2005081688-project Jul 15 20:47:34.965775 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: method: > Jul 15 20:47:34.965775 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: exception: Instance 39e785be-449f-47ab-9327-8b6a91f7d4c3 could not be found. Jul 15 20:47:34.965775 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: action_args: {'id': '39e785be-449f-47ab-9327-8b6a91f7d4c3'} Jul 15 20:47:34.967000 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 20:47:34.967000 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:47:34.967000 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 20:47:34.967000 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 20:47:34.967000 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 20:47:34.967000 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 20:47:34.967000 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 20:47:34.967000 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 20:47:34.967000 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 20:47:34.967000 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 20:47:34.967000 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39e785be-449f-47ab-9327-8b6a91f7d4c3 could not be found. Jul 15 20:47:34.967000 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:47:34.967000 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:47:34.967000 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:47:34.967000 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:47:34.967000 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:47:34.967000 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:47:34.967000 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 20:47:34.967000 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 20:47:34.967000 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 20:47:34.968613 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 20:47:34.968613 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 20:47:34.968613 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 20:47:34.968613 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 20:47:34.968613 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 20:47:34.968613 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 20:47:34.968613 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 20:47:34.968613 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39e785be-449f-47ab-9327-8b6a91f7d4c3 could not be found. Jul 15 20:47:34.968613 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:47:34.968613 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:47:34.968613 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:47:34.968613 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:47:34.968613 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:47:34.968613 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:47:34.968613 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 20:47:34.968613 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 20:47:34.968613 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39e785be-449f-47ab-9327-8b6a91f7d4c3 could not be found. Jul 15 20:47:34.968613 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:47:34.970631 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-ebf53e4c-e80a-41bb-a165-ca2c87441957 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Returning 404 to user: Instance 39e785be-449f-47ab-9327-8b6a91f7d4c3 could not be found. {{(pid=124430) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 20:47:34.970631 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-ebf53e4c-e80a-41bb-a165-ca2c87441957 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3" status: 404 len: 111 microversion: 2.20 time: 0.030607 Jul 15 20:47:34.970631 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 540/1080] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:47:34 2022] GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 15 20:47:34.974176 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-d8dbffa2-11a3-43d8-8f74-462642304bf0 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '.version_select at 0x7ff5183e85e0>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:47:34.977736 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d8dbffa2-11a3-43d8-8f74-462642304bf0 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [855ebffe-aae8-4b40-907e-829be988163b] AMQP server on 10.222.0.66:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 15 20:47:35.424184 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-5ec30e05-c5b3-4678-aab7-f856024aa8ba tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:47:35.424813 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-5ec30e05-c5b3-4678-aab7-f856024aa8ba tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] [instance: 9293b8fc-2bf0-481f-ac99-e06e586fcb5d] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:47:35.430881 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-5ec30e05-c5b3-4678-aab7-f856024aa8ba tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:47:35.431334 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-5ec30e05-c5b3-4678-aab7-f856024aa8ba tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:47:35.432092 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-5ec30e05-c5b3-4678-aab7-f856024aa8ba tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:47:35.432559 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-5ec30e05-c5b3-4678-aab7-f856024aa8ba tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:47:35.455063 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:47:35.567345 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-5ec30e05-c5b3-4678-aab7-f856024aa8ba tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5f88b90c3b43439d4f3f9b3dc63fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c09076eac534571bd221e2cc5872fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:47:35.575086 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-5ec30e05-c5b3-4678-aab7-f856024aa8ba tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] 10.222.0.66 "GET /compute/v2.1/servers/9293b8fc-2bf0-481f-ac99-e06e586fcb5d" status: 200 len: 1453 microversion: 2.1 time: 0.155304 Jul 15 20:47:35.575640 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 541/1081] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:47:35 2022] GET /compute/v2.1/servers/9293b8fc-2bf0-481f-ac99-e06e586fcb5d => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:47:35.590834 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-db835084-469e-4830-9ce2-239e094da44c tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:47:35.591429 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-db835084-469e-4830-9ce2-239e094da44c tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] [instance: 9293b8fc-2bf0-481f-ac99-e06e586fcb5d] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:47:35.597246 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-db835084-469e-4830-9ce2-239e094da44c tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:47:35.597696 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-db835084-469e-4830-9ce2-239e094da44c tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:47:35.598446 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-db835084-469e-4830-9ce2-239e094da44c tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:47:35.598882 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-db835084-469e-4830-9ce2-239e094da44c tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:47:35.731781 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-db835084-469e-4830-9ce2-239e094da44c tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5f88b90c3b43439d4f3f9b3dc63fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c09076eac534571bd221e2cc5872fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:47:35.739788 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-db835084-469e-4830-9ce2-239e094da44c tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] 10.222.0.66 "GET /compute/v2.1/servers/9293b8fc-2bf0-481f-ac99-e06e586fcb5d" status: 200 len: 1453 microversion: 2.1 time: 0.152439 Jul 15 20:47:35.740349 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 542/1082] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:47:35 2022] GET /compute/v2.1/servers/9293b8fc-2bf0-481f-ac99-e06e586fcb5d => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:47:35.987752 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO oslo.messaging._drivers.impl_rabbit [None req-d8dbffa2-11a3-43d8-8f74-462642304bf0 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [855ebffe-aae8-4b40-907e-829be988163b] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 40534. Jul 15 20:47:36.007217 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-d8dbffa2-11a3-43d8-8f74-462642304bf0 tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-433306362" status: 204 len: 0 microversion: 2.20 time: 1.036771 Jul 15 20:47:36.007899 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 541/1083] 10.222.0.66 () {60 vars in 1258 bytes} [Fri Jul 15 20:47:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-433306362 => generated 0 bytes in 1038 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 15 20:47:37.459070 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [req-b978a09e-01f3-4416-bf08-653e1a02446e req-778b1993-38ef-42a7-9afb-bd10b14354e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9293b8fc-2bf0-481f-ac99-e06e586fcb5d", "tag": "f2037b81-737e-4a90-bc77-00e0442b9d7a"}]} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:47:37.467242 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-b978a09e-01f3-4416-bf08-653e1a02446e req-778b1993-38ef-42a7-9afb-bd10b14354e4 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:47:37.468189 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-b978a09e-01f3-4416-bf08-653e1a02446e req-778b1993-38ef-42a7-9afb-bd10b14354e4 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:47:37.479587 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.compute.server_external_events [req-b978a09e-01f3-4416-bf08-653e1a02446e req-778b1993-38ef-42a7-9afb-bd10b14354e4 service nova] Creating event network-changed:f2037b81-737e-4a90-bc77-00e0442b9d7a for instance 9293b8fc-2bf0-481f-ac99-e06e586fcb5d on hv-cinder-79987 Jul 15 20:47:37.485567 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [req-b978a09e-01f3-4416-bf08-653e1a02446e req-778b1993-38ef-42a7-9afb-bd10b14354e4 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088574 Jul 15 20:47:37.486162 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 543/1084] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:47:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:47:37.784593 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-187e6b24-4c40-4371-80b6-378e3c50c50d tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:47:37.785151 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-187e6b24-4c40-4371-80b6-378e3c50c50d tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 39e785be-449f-47ab-9327-8b6a91f7d4c3] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:47:37.792200 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-187e6b24-4c40-4371-80b6-378e3c50c50d tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:47:37.792689 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-187e6b24-4c40-4371-80b6-378e3c50c50d tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:47:37.793720 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-187e6b24-4c40-4371-80b6-378e3c50c50d tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:47:37.794148 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-187e6b24-4c40-4371-80b6-378e3c50c50d tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:47:37.808479 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.wsgi [None req-187e6b24-4c40-4371-80b6-378e3c50c50d tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] HTTP exception thrown: Instance 39e785be-449f-47ab-9327-8b6a91f7d4c3 could not be found. Jul 15 20:47:37.810540 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-187e6b24-4c40-4371-80b6-378e3c50c50d tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Request method failure captured: Jul 15 20:47:37.810540 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: request: DELETE /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3 HTTP/1.1 Jul 15 20:47:37.810540 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Accept: application/json Jul 15 20:47:37.810540 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Accept-Encoding: identity Jul 15 20:47:37.810540 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Connection: close Jul 15 20:47:37.810540 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Content-Length: 0 Jul 15 20:47:37.810540 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Content-Type: application/json Jul 15 20:47:37.810540 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Host: 10.222.0.66 Jul 15 20:47:37.810540 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Openstack-System-Scope: None Jul 15 20:47:37.810540 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: User-Agent: python-urllib3/1.26.9 Jul 15 20:47:37.810540 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Auth-Token: gAAAAABi0dFH_kVmw3XM2IjdbWBHIk7iAsXHabdarxNv4clC7Z6b_TX2DNTWs6HZczbnRUGIwqWChZTwOuYcLMLRL0a1j1H_SaNHcdSWv83qyG1N6BZb2ZfqDMmHNqn-xC38vSrGK9hibvfMLjHFo_ycldhvWSibqI1pbQytko_qiHZAl_ZlM0Y Jul 15 20:47:37.810540 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Domain-Id: None Jul 15 20:47:37.810540 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Domain-Name: None Jul 15 20:47:37.810540 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Identity-Status: Confirmed Jul 15 20:47:37.810540 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Is-Admin-Project: True Jul 15 20:47:37.810540 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Openstack-Nova-Api-Version: 2.20 Jul 15 20:47:37.810540 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Domain-Id: default Jul 15 20:47:37.810540 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Domain-Name: Default Jul 15 20:47:37.810540 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Id: f852483a41394ef699c09ccee827fa28 Jul 15 20:47:37.810540 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2005081688 Jul 15 20:47:37.810540 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Role: member,reader Jul 15 20:47:37.810540 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Roles: member,reader Jul 15 20:47:37.816093 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f852483a41394ef699c09ccee827fa28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f852483a41394ef699c09ccee827fa28"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f852483a41394ef699c09ccee827fa28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f852483a41394ef699c09ccee827fa28"}]}] Jul 15 20:47:37.816093 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2005081688 Jul 15 20:47:37.816093 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Tenant-Id: f852483a41394ef699c09ccee827fa28 Jul 15 20:47:37.816093 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2005081688 Jul 15 20:47:37.816093 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User: tempest-AttachVolumeShelveTestJSON-2005081688-project Jul 15 20:47:37.816093 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Domain-Id: default Jul 15 20:47:37.816093 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Domain-Name: Default Jul 15 20:47:37.816093 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Id: fbe7070e9384403ca998a996e8dd6b50 Jul 15 20:47:37.816093 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2005081688-project Jul 15 20:47:37.816093 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: method: > Jul 15 20:47:37.816093 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: exception: Instance 39e785be-449f-47ab-9327-8b6a91f7d4c3 could not be found. Jul 15 20:47:37.816093 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: action_args: {'id': '39e785be-449f-47ab-9327-8b6a91f7d4c3'} Jul 15 20:47:37.817149 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 20:47:37.817149 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:47:37.817149 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 20:47:37.817149 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 20:47:37.817149 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 20:47:37.817149 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 20:47:37.817149 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 20:47:37.817149 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 20:47:37.817149 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 20:47:37.817149 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 20:47:37.817149 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39e785be-449f-47ab-9327-8b6a91f7d4c3 could not be found. Jul 15 20:47:37.817149 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:47:37.817149 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:47:37.817149 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:47:37.817149 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:47:37.817149 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:47:37.817149 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:47:37.817149 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 20:47:37.817149 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 20:47:37.817149 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 20:47:37.818511 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 20:47:37.818511 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 15 20:47:37.818511 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 15 20:47:37.818511 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 15 20:47:37.818511 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 15 20:47:37.818511 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 20:47:37.818511 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 20:47:37.818511 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 20:47:37.818511 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 20:47:37.818511 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39e785be-449f-47ab-9327-8b6a91f7d4c3 could not be found. Jul 15 20:47:37.818511 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:47:37.818511 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:47:37.818511 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:47:37.818511 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:47:37.818511 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:47:37.818511 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:47:37.818511 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 20:47:37.818511 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 20:47:37.818511 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39e785be-449f-47ab-9327-8b6a91f7d4c3 could not be found. Jul 15 20:47:37.818511 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:47:37.819828 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-187e6b24-4c40-4371-80b6-378e3c50c50d tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Returning 404 to user: Instance 39e785be-449f-47ab-9327-8b6a91f7d4c3 could not be found. {{(pid=124432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 20:47:37.819828 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-187e6b24-4c40-4371-80b6-378e3c50c50d tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "DELETE /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3" status: 404 len: 111 microversion: 2.20 time: 0.032682 Jul 15 20:47:37.819828 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 542/1085] 10.222.0.66 () {60 vars in 1279 bytes} [Fri Jul 15 20:47:37 2022] DELETE /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 15 20:47:37.821683 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-d46d1692-b793-45c4-983e-1b2dd1effedb tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:47:37.822368 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-d46d1692-b793-45c4-983e-1b2dd1effedb tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 39e785be-449f-47ab-9327-8b6a91f7d4c3] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:47:37.828910 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d46d1692-b793-45c4-983e-1b2dd1effedb tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:47:37.829355 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d46d1692-b793-45c4-983e-1b2dd1effedb tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:47:37.830269 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d46d1692-b793-45c4-983e-1b2dd1effedb tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:47:37.830703 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d46d1692-b793-45c4-983e-1b2dd1effedb tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:47:37.844470 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.wsgi [None req-d46d1692-b793-45c4-983e-1b2dd1effedb tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] HTTP exception thrown: Instance 39e785be-449f-47ab-9327-8b6a91f7d4c3 could not be found. Jul 15 20:47:37.846068 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-d46d1692-b793-45c4-983e-1b2dd1effedb tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Request method failure captured: Jul 15 20:47:37.846068 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: request: GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3 HTTP/1.1 Jul 15 20:47:37.846068 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Accept: application/json Jul 15 20:47:37.846068 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Accept-Encoding: identity Jul 15 20:47:37.846068 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Connection: close Jul 15 20:47:37.846068 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Content-Length: 0 Jul 15 20:47:37.846068 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Content-Type: application/json Jul 15 20:47:37.846068 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Host: 10.222.0.66 Jul 15 20:47:37.846068 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Openstack-System-Scope: None Jul 15 20:47:37.846068 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: User-Agent: python-urllib3/1.26.9 Jul 15 20:47:37.846068 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Auth-Token: gAAAAABi0dFH_kVmw3XM2IjdbWBHIk7iAsXHabdarxNv4clC7Z6b_TX2DNTWs6HZczbnRUGIwqWChZTwOuYcLMLRL0a1j1H_SaNHcdSWv83qyG1N6BZb2ZfqDMmHNqn-xC38vSrGK9hibvfMLjHFo_ycldhvWSibqI1pbQytko_qiHZAl_ZlM0Y Jul 15 20:47:37.846068 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Domain-Id: None Jul 15 20:47:37.846068 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Domain-Name: None Jul 15 20:47:37.846068 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Identity-Status: Confirmed Jul 15 20:47:37.846068 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Is-Admin-Project: True Jul 15 20:47:37.846068 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Openstack-Nova-Api-Version: 2.20 Jul 15 20:47:37.846068 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Domain-Id: default Jul 15 20:47:37.846068 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Domain-Name: Default Jul 15 20:47:37.846068 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Id: f852483a41394ef699c09ccee827fa28 Jul 15 20:47:37.846068 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2005081688 Jul 15 20:47:37.846068 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Role: member,reader Jul 15 20:47:37.846068 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Roles: member,reader Jul 15 20:47:37.847508 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f852483a41394ef699c09ccee827fa28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f852483a41394ef699c09ccee827fa28"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f852483a41394ef699c09ccee827fa28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f852483a41394ef699c09ccee827fa28"}]}] Jul 15 20:47:37.847508 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2005081688 Jul 15 20:47:37.847508 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant-Id: f852483a41394ef699c09ccee827fa28 Jul 15 20:47:37.847508 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2005081688 Jul 15 20:47:37.847508 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User: tempest-AttachVolumeShelveTestJSON-2005081688-project Jul 15 20:47:37.847508 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Domain-Id: default Jul 15 20:47:37.847508 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Domain-Name: Default Jul 15 20:47:37.847508 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Id: fbe7070e9384403ca998a996e8dd6b50 Jul 15 20:47:37.847508 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2005081688-project Jul 15 20:47:37.847508 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: method: > Jul 15 20:47:37.847508 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: exception: Instance 39e785be-449f-47ab-9327-8b6a91f7d4c3 could not be found. Jul 15 20:47:37.847508 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: action_args: {'id': '39e785be-449f-47ab-9327-8b6a91f7d4c3'} Jul 15 20:47:37.851358 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 20:47:37.851358 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:47:37.851358 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 20:47:37.851358 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 20:47:37.851358 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 20:47:37.851358 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 20:47:37.851358 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 20:47:37.851358 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 20:47:37.851358 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 20:47:37.851358 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 20:47:37.851358 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39e785be-449f-47ab-9327-8b6a91f7d4c3 could not be found. Jul 15 20:47:37.851358 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:47:37.851358 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:47:37.851358 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:47:37.851358 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:47:37.851358 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:47:37.851358 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:47:37.851358 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 20:47:37.851358 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 20:47:37.851358 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 20:47:37.852651 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 20:47:37.852651 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 20:47:37.852651 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 20:47:37.852651 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 20:47:37.852651 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 20:47:37.852651 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 20:47:37.852651 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 20:47:37.852651 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39e785be-449f-47ab-9327-8b6a91f7d4c3 could not be found. Jul 15 20:47:37.852651 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:47:37.852651 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:47:37.852651 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:47:37.852651 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:47:37.852651 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:47:37.852651 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:47:37.852651 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 20:47:37.852651 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 20:47:37.852651 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39e785be-449f-47ab-9327-8b6a91f7d4c3 could not be found. Jul 15 20:47:37.852651 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:47:37.854215 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-d46d1692-b793-45c4-983e-1b2dd1effedb tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Returning 404 to user: Instance 39e785be-449f-47ab-9327-8b6a91f7d4c3 could not be found. {{(pid=124430) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 20:47:37.854215 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-d46d1692-b793-45c4-983e-1b2dd1effedb tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3" status: 404 len: 111 microversion: 2.20 time: 0.030131 Jul 15 20:47:37.854215 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 544/1086] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:47:37 2022] GET /compute/v2.1/servers/39e785be-449f-47ab-9327-8b6a91f7d4c3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 15 20:47:38.998915 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-7e9beb12-3190-44c0-8936-8ccd9c9bacdd tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:47:38.999597 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-7e9beb12-3190-44c0-8936-8ccd9c9bacdd tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 526626a0-8b46-4f4a-9371-4b310ac67640] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:47:39.006441 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7e9beb12-3190-44c0-8936-8ccd9c9bacdd tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:47:39.006882 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7e9beb12-3190-44c0-8936-8ccd9c9bacdd tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:47:39.007637 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7e9beb12-3190-44c0-8936-8ccd9c9bacdd tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:47:39.008069 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7e9beb12-3190-44c0-8936-8ccd9c9bacdd tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:47:39.021085 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.wsgi [None req-7e9beb12-3190-44c0-8936-8ccd9c9bacdd tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] HTTP exception thrown: Instance 526626a0-8b46-4f4a-9371-4b310ac67640 could not be found. Jul 15 20:47:39.022612 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-7e9beb12-3190-44c0-8936-8ccd9c9bacdd tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Request method failure captured: Jul 15 20:47:39.022612 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: request: DELETE /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640 HTTP/1.1 Jul 15 20:47:39.022612 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Accept: application/json Jul 15 20:47:39.022612 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Accept-Encoding: identity Jul 15 20:47:39.022612 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Connection: close Jul 15 20:47:39.022612 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Content-Length: 0 Jul 15 20:47:39.022612 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Content-Type: application/json Jul 15 20:47:39.022612 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Host: 10.222.0.66 Jul 15 20:47:39.022612 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Openstack-System-Scope: None Jul 15 20:47:39.022612 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: User-Agent: python-urllib3/1.26.9 Jul 15 20:47:39.022612 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Auth-Token: gAAAAABi0dFH_kVmw3XM2IjdbWBHIk7iAsXHabdarxNv4clC7Z6b_TX2DNTWs6HZczbnRUGIwqWChZTwOuYcLMLRL0a1j1H_SaNHcdSWv83qyG1N6BZb2ZfqDMmHNqn-xC38vSrGK9hibvfMLjHFo_ycldhvWSibqI1pbQytko_qiHZAl_ZlM0Y Jul 15 20:47:39.022612 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Domain-Id: None Jul 15 20:47:39.022612 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Domain-Name: None Jul 15 20:47:39.022612 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Identity-Status: Confirmed Jul 15 20:47:39.022612 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Is-Admin-Project: True Jul 15 20:47:39.022612 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Openstack-Nova-Api-Version: 2.20 Jul 15 20:47:39.022612 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Domain-Id: default Jul 15 20:47:39.022612 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Domain-Name: Default Jul 15 20:47:39.022612 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Id: f852483a41394ef699c09ccee827fa28 Jul 15 20:47:39.022612 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2005081688 Jul 15 20:47:39.022612 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Role: member,reader Jul 15 20:47:39.022612 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Roles: member,reader Jul 15 20:47:39.024314 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f852483a41394ef699c09ccee827fa28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f852483a41394ef699c09ccee827fa28"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f852483a41394ef699c09ccee827fa28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f852483a41394ef699c09ccee827fa28"}]}] Jul 15 20:47:39.024314 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2005081688 Jul 15 20:47:39.024314 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Tenant-Id: f852483a41394ef699c09ccee827fa28 Jul 15 20:47:39.024314 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2005081688 Jul 15 20:47:39.024314 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User: tempest-AttachVolumeShelveTestJSON-2005081688-project Jul 15 20:47:39.024314 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Domain-Id: default Jul 15 20:47:39.024314 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Domain-Name: Default Jul 15 20:47:39.024314 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Id: fbe7070e9384403ca998a996e8dd6b50 Jul 15 20:47:39.024314 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2005081688-project Jul 15 20:47:39.024314 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: method: > Jul 15 20:47:39.024314 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: exception: Instance 526626a0-8b46-4f4a-9371-4b310ac67640 could not be found. Jul 15 20:47:39.024314 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: action_args: {'id': '526626a0-8b46-4f4a-9371-4b310ac67640'} Jul 15 20:47:39.025276 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 20:47:39.025276 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:47:39.025276 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 20:47:39.025276 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 20:47:39.025276 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 20:47:39.025276 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 20:47:39.025276 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 20:47:39.025276 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 20:47:39.025276 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 20:47:39.025276 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 20:47:39.025276 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 526626a0-8b46-4f4a-9371-4b310ac67640 could not be found. Jul 15 20:47:39.025276 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:47:39.025276 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:47:39.025276 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:47:39.025276 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:47:39.025276 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:47:39.025276 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:47:39.025276 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 20:47:39.025276 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 20:47:39.025276 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 20:47:39.026818 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 20:47:39.026818 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 15 20:47:39.026818 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 15 20:47:39.026818 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 15 20:47:39.026818 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 15 20:47:39.026818 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 20:47:39.026818 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 20:47:39.026818 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 20:47:39.026818 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 20:47:39.026818 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 526626a0-8b46-4f4a-9371-4b310ac67640 could not be found. Jul 15 20:47:39.026818 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:47:39.026818 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:47:39.026818 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:47:39.026818 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:47:39.026818 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:47:39.026818 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:47:39.026818 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 20:47:39.026818 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 20:47:39.026818 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 526626a0-8b46-4f4a-9371-4b310ac67640 could not be found. Jul 15 20:47:39.026818 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:47:39.028356 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-7e9beb12-3190-44c0-8936-8ccd9c9bacdd tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Returning 404 to user: Instance 526626a0-8b46-4f4a-9371-4b310ac67640 could not be found. {{(pid=124432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 20:47:39.028356 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-7e9beb12-3190-44c0-8936-8ccd9c9bacdd tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "DELETE /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640" status: 404 len: 111 microversion: 2.20 time: 0.029089 Jul 15 20:47:39.028356 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 543/1087] 10.222.0.66 () {60 vars in 1279 bytes} [Fri Jul 15 20:47:38 2022] DELETE /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 15 20:47:39.033036 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-6b7d9d94-803b-44aa-bde0-fa03dd9c696a tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:47:39.033640 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-6b7d9d94-803b-44aa-bde0-fa03dd9c696a tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] [instance: 526626a0-8b46-4f4a-9371-4b310ac67640] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:47:39.040075 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-6b7d9d94-803b-44aa-bde0-fa03dd9c696a tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:47:39.040560 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-6b7d9d94-803b-44aa-bde0-fa03dd9c696a tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:47:39.041320 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-6b7d9d94-803b-44aa-bde0-fa03dd9c696a tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:47:39.041750 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-6b7d9d94-803b-44aa-bde0-fa03dd9c696a tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:47:39.055629 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.wsgi [None req-6b7d9d94-803b-44aa-bde0-fa03dd9c696a tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] HTTP exception thrown: Instance 526626a0-8b46-4f4a-9371-4b310ac67640 could not be found. Jul 15 20:47:39.057159 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-6b7d9d94-803b-44aa-bde0-fa03dd9c696a tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Request method failure captured: Jul 15 20:47:39.057159 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: request: GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640 HTTP/1.1 Jul 15 20:47:39.057159 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Accept: application/json Jul 15 20:47:39.057159 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Accept-Encoding: identity Jul 15 20:47:39.057159 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Connection: close Jul 15 20:47:39.057159 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Content-Length: 0 Jul 15 20:47:39.057159 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Content-Type: application/json Jul 15 20:47:39.057159 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Host: 10.222.0.66 Jul 15 20:47:39.057159 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Openstack-System-Scope: None Jul 15 20:47:39.057159 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: User-Agent: python-urllib3/1.26.9 Jul 15 20:47:39.057159 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Auth-Token: gAAAAABi0dFH_kVmw3XM2IjdbWBHIk7iAsXHabdarxNv4clC7Z6b_TX2DNTWs6HZczbnRUGIwqWChZTwOuYcLMLRL0a1j1H_SaNHcdSWv83qyG1N6BZb2ZfqDMmHNqn-xC38vSrGK9hibvfMLjHFo_ycldhvWSibqI1pbQytko_qiHZAl_ZlM0Y Jul 15 20:47:39.057159 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Domain-Id: None Jul 15 20:47:39.057159 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Domain-Name: None Jul 15 20:47:39.057159 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Identity-Status: Confirmed Jul 15 20:47:39.057159 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Is-Admin-Project: True Jul 15 20:47:39.057159 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Openstack-Nova-Api-Version: 2.20 Jul 15 20:47:39.057159 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Domain-Id: default Jul 15 20:47:39.057159 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Domain-Name: Default Jul 15 20:47:39.057159 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Id: f852483a41394ef699c09ccee827fa28 Jul 15 20:47:39.057159 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2005081688 Jul 15 20:47:39.057159 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Role: member,reader Jul 15 20:47:39.057159 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Roles: member,reader Jul 15 20:47:39.058843 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f852483a41394ef699c09ccee827fa28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f852483a41394ef699c09ccee827fa28"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f852483a41394ef699c09ccee827fa28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f852483a41394ef699c09ccee827fa28"}]}] Jul 15 20:47:39.058843 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2005081688 Jul 15 20:47:39.058843 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant-Id: f852483a41394ef699c09ccee827fa28 Jul 15 20:47:39.058843 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2005081688 Jul 15 20:47:39.058843 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User: tempest-AttachVolumeShelveTestJSON-2005081688-project Jul 15 20:47:39.058843 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Domain-Id: default Jul 15 20:47:39.058843 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Domain-Name: Default Jul 15 20:47:39.058843 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Id: fbe7070e9384403ca998a996e8dd6b50 Jul 15 20:47:39.058843 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2005081688-project Jul 15 20:47:39.058843 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: method: > Jul 15 20:47:39.058843 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: exception: Instance 526626a0-8b46-4f4a-9371-4b310ac67640 could not be found. Jul 15 20:47:39.058843 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: action_args: {'id': '526626a0-8b46-4f4a-9371-4b310ac67640'} Jul 15 20:47:39.059803 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 20:47:39.059803 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:47:39.059803 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 20:47:39.059803 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 20:47:39.059803 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 20:47:39.059803 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 20:47:39.059803 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 20:47:39.059803 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 20:47:39.059803 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 20:47:39.059803 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 20:47:39.059803 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 526626a0-8b46-4f4a-9371-4b310ac67640 could not be found. Jul 15 20:47:39.059803 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:47:39.059803 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:47:39.059803 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:47:39.059803 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:47:39.059803 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:47:39.059803 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:47:39.059803 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 20:47:39.059803 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 20:47:39.059803 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 20:47:39.061506 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 20:47:39.061506 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 20:47:39.061506 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 20:47:39.061506 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 20:47:39.061506 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 20:47:39.061506 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 20:47:39.061506 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 20:47:39.061506 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 526626a0-8b46-4f4a-9371-4b310ac67640 could not be found. Jul 15 20:47:39.061506 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:47:39.061506 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:47:39.061506 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:47:39.061506 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:47:39.061506 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:47:39.061506 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:47:39.061506 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 20:47:39.061506 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 20:47:39.061506 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 526626a0-8b46-4f4a-9371-4b310ac67640 could not be found. Jul 15 20:47:39.061506 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:47:39.062869 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-6b7d9d94-803b-44aa-bde0-fa03dd9c696a tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] Returning 404 to user: Instance 526626a0-8b46-4f4a-9371-4b310ac67640 could not be found. {{(pid=124430) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 20:47:39.062869 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-6b7d9d94-803b-44aa-bde0-fa03dd9c696a tempest-AttachVolumeShelveTestJSON-2005081688 tempest-AttachVolumeShelveTestJSON-2005081688-project] 10.222.0.66 "GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640" status: 404 len: 111 microversion: 2.20 time: 0.030009 Jul 15 20:47:39.062869 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 545/1088] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 15 20:47:39 2022] GET /compute/v2.1/servers/526626a0-8b46-4f4a-9371-4b310ac67640 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 15 20:48:33.571130 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 15 20:48:33.572262 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Fri Jul 15 20:48:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 15 20:49:29.685502 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-7f5cc74d-2e29-49ac-ae18-91c53461407e tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-132773827", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2104996658", "security_groups": [{"name": "tempest-secgroup-smoke-778498841"}], "block_device_mapping_v2": [{"uuid": "22d3bce9-48f3-48cd-9387-276251dc1be2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "66a9f55c-6da3-47d0-86fe-281ad3b00d29"}]}} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:49:29.694457 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:49:29.695307 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell1:SELECT=88 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:49:29.800892 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.network.neutron [None req-7f5cc74d-2e29-49ac-ae18-91c53461407e tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] validate_networks() for [('66a9f55c-6da3-47d0-86fe-281ad3b00d29', None, None, None, None, None)] {{(pid=124432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 20:49:30.159533 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-7f5cc74d-2e29-49ac-ae18-91c53461407e tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Flavor limits 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 20:49:30.159960 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-7f5cc74d-2e29-49ac-ae18-91c53461407e tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Image limits 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 20:49:30.160535 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-7f5cc74d-2e29-49ac-ae18-91c53461407e tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Flavor pref 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 20:49:30.160950 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-7f5cc74d-2e29-49ac-ae18-91c53461407e tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Image pref 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 20:49:30.161361 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-7f5cc74d-2e29-49ac-ae18-91c53461407e tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 20:49:30.170201 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7f5cc74d-2e29-49ac-ae18-91c53461407e tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:49:30.170910 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7f5cc74d-2e29-49ac-ae18-91c53461407e tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:49:30.172016 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7f5cc74d-2e29-49ac-ae18-91c53461407e tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:49:30.172486 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7f5cc74d-2e29-49ac-ae18-91c53461407e tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:49:30.189520 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-7f5cc74d-2e29-49ac-ae18-91c53461407e tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Getting quotas for project 6c09076eac534571bd221e2cc5872fc6. Resources: {'instances', 'ram', 'cores'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 20:49:30.193483 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-7f5cc74d-2e29-49ac-ae18-91c53461407e tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Getting quotas for user ce5f88b90c3b43439d4f3f9b3dc63fff and project 6c09076eac534571bd221e2cc5872fc6. Resources: {'instances', 'ram', 'cores'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 20:49:30.248532 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-7f5cc74d-2e29-49ac-ae18-91c53461407e tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Going to run 1 instances... {{(pid=124432) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 20:49:30.251460 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-7f5cc74d-2e29-49ac-ae18-91c53461407e tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] [instance: 79357f76-766a-47c5-96e9-00d2aaebdad7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='22d3bce9-48f3-48cd-9387-276251dc1be2',volume_size=None,volume_type=None)] {{(pid=124432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 20:49:30.379006 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-7f5cc74d-2e29-49ac-ae18-91c53461407e tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.697924 Jul 15 20:49:30.379644 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 544/1089] 10.222.0.66 () {60 vars in 1146 bytes} [Fri Jul 15 20:49:29 2022] POST /compute/v2.1/servers => generated 405 bytes in 699 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 20:49:30.387477 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=2 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:49:30.388235 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_cell1:SELECT=14 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:49:30.393246 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-653e74d9-b8e9-47ed-bd17-03c72fe05f8d tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:49:30.393851 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-653e74d9-b8e9-47ed-bd17-03c72fe05f8d tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] [instance: 79357f76-766a-47c5-96e9-00d2aaebdad7] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:49:30.453974 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-653e74d9-b8e9-47ed-bd17-03c72fe05f8d tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5f88b90c3b43439d4f3f9b3dc63fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c09076eac534571bd221e2cc5872fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:49:30.461144 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-653e74d9-b8e9-47ed-bd17-03c72fe05f8d tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] 10.222.0.66 "GET /compute/v2.1/servers/79357f76-766a-47c5-96e9-00d2aaebdad7" status: 200 len: 1094 microversion: 2.1 time: 0.075443 Jul 15 20:49:30.462430 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 546/1090] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:49:30 2022] GET /compute/v2.1/servers/79357f76-766a-47c5-96e9-00d2aaebdad7 => generated 1094 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:49:31.479701 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-a160d24e-47c4-480c-83f5-8e1d04e4d319 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:49:31.480480 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-a160d24e-47c4-480c-83f5-8e1d04e4d319 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] [instance: 79357f76-766a-47c5-96e9-00d2aaebdad7] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:49:31.488206 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a160d24e-47c4-480c-83f5-8e1d04e4d319 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:49:31.488717 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a160d24e-47c4-480c-83f5-8e1d04e4d319 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:49:31.489559 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a160d24e-47c4-480c-83f5-8e1d04e4d319 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:49:31.490033 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a160d24e-47c4-480c-83f5-8e1d04e4d319 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:49:31.565248 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-a160d24e-47c4-480c-83f5-8e1d04e4d319 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5f88b90c3b43439d4f3f9b3dc63fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c09076eac534571bd221e2cc5872fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:49:31.572917 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-a160d24e-47c4-480c-83f5-8e1d04e4d319 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] 10.222.0.66 "GET /compute/v2.1/servers/79357f76-766a-47c5-96e9-00d2aaebdad7" status: 200 len: 1210 microversion: 2.1 time: 0.097708 Jul 15 20:49:31.573480 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 545/1091] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:49:31 2022] GET /compute/v2.1/servers/79357f76-766a-47c5-96e9-00d2aaebdad7 => generated 1210 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:49:32.591244 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-1eaa1664-f628-4653-b80f-e3dc888e7ed3 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:49:32.592186 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-1eaa1664-f628-4653-b80f-e3dc888e7ed3 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] [instance: 79357f76-766a-47c5-96e9-00d2aaebdad7] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:49:32.601292 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-1eaa1664-f628-4653-b80f-e3dc888e7ed3 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:49:32.602017 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-1eaa1664-f628-4653-b80f-e3dc888e7ed3 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:49:32.603048 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-1eaa1664-f628-4653-b80f-e3dc888e7ed3 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:49:32.603483 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-1eaa1664-f628-4653-b80f-e3dc888e7ed3 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:49:32.722724 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-29da9d48-a7e3-4e01-b3ee-b8382ddcce9b req-00f3cae8-31bb-4327-b129-816a30caa512 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79357f76-766a-47c5-96e9-00d2aaebdad7", "tag": "e574bcd1-198e-44c3-9af4-f6a527b99c75"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:49:32.748725 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-1eaa1664-f628-4653-b80f-e3dc888e7ed3 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5f88b90c3b43439d4f3f9b3dc63fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c09076eac534571bd221e2cc5872fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:49:32.759755 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-29da9d48-a7e3-4e01-b3ee-b8382ddcce9b req-00f3cae8-31bb-4327-b129-816a30caa512 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:49:32.760200 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-29da9d48-a7e3-4e01-b3ee-b8382ddcce9b req-00f3cae8-31bb-4327-b129-816a30caa512 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:49:32.768479 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-1eaa1664-f628-4653-b80f-e3dc888e7ed3 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] 10.222.0.66 "GET /compute/v2.1/servers/79357f76-766a-47c5-96e9-00d2aaebdad7" status: 200 len: 1265 microversion: 2.1 time: 0.180944 Jul 15 20:49:32.775909 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-29da9d48-a7e3-4e01-b3ee-b8382ddcce9b req-00f3cae8-31bb-4327-b129-816a30caa512 service nova] Creating event network-changed:e574bcd1-198e-44c3-9af4-f6a527b99c75 for instance 79357f76-766a-47c5-96e9-00d2aaebdad7 on hv-cinder-79987 Jul 15 20:49:32.778505 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 547/1092] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:49:32 2022] GET /compute/v2.1/servers/79357f76-766a-47c5-96e9-00d2aaebdad7 => generated 1265 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:49:32.782756 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-29da9d48-a7e3-4e01-b3ee-b8382ddcce9b req-00f3cae8-31bb-4327-b129-816a30caa512 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071088 Jul 15 20:49:32.783356 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 546/1093] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:49:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 20:49:33.786496 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-c7cc2305-ad55-4bb0-85bf-1aa09d085a9a tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:49:33.787107 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-c7cc2305-ad55-4bb0-85bf-1aa09d085a9a tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] [instance: 79357f76-766a-47c5-96e9-00d2aaebdad7] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:49:33.793647 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c7cc2305-ad55-4bb0-85bf-1aa09d085a9a tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:49:33.794094 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c7cc2305-ad55-4bb0-85bf-1aa09d085a9a tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:49:33.794860 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c7cc2305-ad55-4bb0-85bf-1aa09d085a9a tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:49:33.795293 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c7cc2305-ad55-4bb0-85bf-1aa09d085a9a tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:49:33.929741 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-c7cc2305-ad55-4bb0-85bf-1aa09d085a9a tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5f88b90c3b43439d4f3f9b3dc63fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c09076eac534571bd221e2cc5872fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:49:33.937466 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-c7cc2305-ad55-4bb0-85bf-1aa09d085a9a tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] 10.222.0.66 "GET /compute/v2.1/servers/79357f76-766a-47c5-96e9-00d2aaebdad7" status: 200 len: 1265 microversion: 2.1 time: 0.154769 Jul 15 20:49:33.938147 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 548/1094] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:49:33 2022] GET /compute/v2.1/servers/79357f76-766a-47c5-96e9-00d2aaebdad7 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:49:34.955278 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-602c5862-ee1c-49d1-a12f-511ed8aaa5ed tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:49:34.955974 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-602c5862-ee1c-49d1-a12f-511ed8aaa5ed tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] [instance: 79357f76-766a-47c5-96e9-00d2aaebdad7] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:49:34.962301 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-602c5862-ee1c-49d1-a12f-511ed8aaa5ed tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:49:34.962747 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-602c5862-ee1c-49d1-a12f-511ed8aaa5ed tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:49:34.963503 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-602c5862-ee1c-49d1-a12f-511ed8aaa5ed tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:49:34.963933 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-602c5862-ee1c-49d1-a12f-511ed8aaa5ed tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:49:35.093045 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-602c5862-ee1c-49d1-a12f-511ed8aaa5ed tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5f88b90c3b43439d4f3f9b3dc63fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c09076eac534571bd221e2cc5872fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:49:35.100992 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-602c5862-ee1c-49d1-a12f-511ed8aaa5ed tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] 10.222.0.66 "GET /compute/v2.1/servers/79357f76-766a-47c5-96e9-00d2aaebdad7" status: 200 len: 1265 microversion: 2.1 time: 0.150373 Jul 15 20:49:35.101555 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 547/1095] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:49:34 2022] GET /compute/v2.1/servers/79357f76-766a-47c5-96e9-00d2aaebdad7 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:49:36.117961 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-82fc8d76-8bd4-4e69-961b-614c69d7d4f2 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:49:36.118590 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-82fc8d76-8bd4-4e69-961b-614c69d7d4f2 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] [instance: 79357f76-766a-47c5-96e9-00d2aaebdad7] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:49:36.126088 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-82fc8d76-8bd4-4e69-961b-614c69d7d4f2 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:49:36.126088 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-82fc8d76-8bd4-4e69-961b-614c69d7d4f2 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:49:36.126948 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-82fc8d76-8bd4-4e69-961b-614c69d7d4f2 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:49:36.127236 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-82fc8d76-8bd4-4e69-961b-614c69d7d4f2 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:49:36.257139 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-82fc8d76-8bd4-4e69-961b-614c69d7d4f2 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5f88b90c3b43439d4f3f9b3dc63fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c09076eac534571bd221e2cc5872fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:49:36.264606 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-82fc8d76-8bd4-4e69-961b-614c69d7d4f2 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] 10.222.0.66 "GET /compute/v2.1/servers/79357f76-766a-47c5-96e9-00d2aaebdad7" status: 200 len: 1265 microversion: 2.1 time: 0.150519 Jul 15 20:49:36.265828 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 549/1096] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:49:36 2022] GET /compute/v2.1/servers/79357f76-766a-47c5-96e9-00d2aaebdad7 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:49:37.282094 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-1b81f0e3-3414-4198-a4c1-0fbab25f6611 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:49:37.282691 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-1b81f0e3-3414-4198-a4c1-0fbab25f6611 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] [instance: 79357f76-766a-47c5-96e9-00d2aaebdad7] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:49:37.288891 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1b81f0e3-3414-4198-a4c1-0fbab25f6611 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:49:37.289335 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1b81f0e3-3414-4198-a4c1-0fbab25f6611 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:49:37.290100 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1b81f0e3-3414-4198-a4c1-0fbab25f6611 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:49:37.290509 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1b81f0e3-3414-4198-a4c1-0fbab25f6611 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:49:37.417925 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-1b81f0e3-3414-4198-a4c1-0fbab25f6611 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5f88b90c3b43439d4f3f9b3dc63fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c09076eac534571bd221e2cc5872fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:49:37.426398 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-1b81f0e3-3414-4198-a4c1-0fbab25f6611 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] 10.222.0.66 "GET /compute/v2.1/servers/79357f76-766a-47c5-96e9-00d2aaebdad7" status: 200 len: 1265 microversion: 2.1 time: 0.148307 Jul 15 20:49:37.426959 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 548/1097] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:49:37 2022] GET /compute/v2.1/servers/79357f76-766a-47c5-96e9-00d2aaebdad7 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:49:38.442456 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-d59e80d8-072b-491b-ad3c-ad6ccfee016c tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:49:38.443065 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-d59e80d8-072b-491b-ad3c-ad6ccfee016c tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] [instance: 79357f76-766a-47c5-96e9-00d2aaebdad7] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:49:38.449625 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d59e80d8-072b-491b-ad3c-ad6ccfee016c tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:49:38.450073 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d59e80d8-072b-491b-ad3c-ad6ccfee016c tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:49:38.450835 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d59e80d8-072b-491b-ad3c-ad6ccfee016c tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:49:38.451307 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-d59e80d8-072b-491b-ad3c-ad6ccfee016c tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:49:38.586088 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-d59e80d8-072b-491b-ad3c-ad6ccfee016c tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5f88b90c3b43439d4f3f9b3dc63fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c09076eac534571bd221e2cc5872fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:49:38.594675 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-d59e80d8-072b-491b-ad3c-ad6ccfee016c tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] 10.222.0.66 "GET /compute/v2.1/servers/79357f76-766a-47c5-96e9-00d2aaebdad7" status: 200 len: 1265 microversion: 2.1 time: 0.155852 Jul 15 20:49:38.595668 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 550/1098] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:49:38 2022] GET /compute/v2.1/servers/79357f76-766a-47c5-96e9-00d2aaebdad7 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:49:39.725861 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-c61b5643-2ac2-4f73-aaa6-1124f16bf8fb tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:49:39.726653 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-c61b5643-2ac2-4f73-aaa6-1124f16bf8fb tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] [instance: 79357f76-766a-47c5-96e9-00d2aaebdad7] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:49:39.732677 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c61b5643-2ac2-4f73-aaa6-1124f16bf8fb tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:49:39.733124 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c61b5643-2ac2-4f73-aaa6-1124f16bf8fb tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:49:39.734089 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c61b5643-2ac2-4f73-aaa6-1124f16bf8fb tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:49:39.734521 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c61b5643-2ac2-4f73-aaa6-1124f16bf8fb tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:49:39.868953 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-c61b5643-2ac2-4f73-aaa6-1124f16bf8fb tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5f88b90c3b43439d4f3f9b3dc63fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c09076eac534571bd221e2cc5872fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:49:39.877342 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-c61b5643-2ac2-4f73-aaa6-1124f16bf8fb tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] 10.222.0.66 "GET /compute/v2.1/servers/79357f76-766a-47c5-96e9-00d2aaebdad7" status: 200 len: 1265 microversion: 2.1 time: 0.268899 Jul 15 20:49:39.877898 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 549/1099] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:49:39 2022] GET /compute/v2.1/servers/79357f76-766a-47c5-96e9-00d2aaebdad7 => generated 1265 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:49:40.894797 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-c611cab6-327d-42b5-8ca0-93c23035b535 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:49:40.895398 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-c611cab6-327d-42b5-8ca0-93c23035b535 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] [instance: 79357f76-766a-47c5-96e9-00d2aaebdad7] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:49:40.897813 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_cell0:SELECT=2 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:49:40.903281 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c611cab6-327d-42b5-8ca0-93c23035b535 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:49:40.903722 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c611cab6-327d-42b5-8ca0-93c23035b535 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:49:40.904489 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c611cab6-327d-42b5-8ca0-93c23035b535 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:49:40.904923 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c611cab6-327d-42b5-8ca0-93c23035b535 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:49:41.032898 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-c611cab6-327d-42b5-8ca0-93c23035b535 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5f88b90c3b43439d4f3f9b3dc63fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c09076eac534571bd221e2cc5872fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:49:41.040160 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-c611cab6-327d-42b5-8ca0-93c23035b535 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] 10.222.0.66 "GET /compute/v2.1/servers/79357f76-766a-47c5-96e9-00d2aaebdad7" status: 200 len: 1265 microversion: 2.1 time: 0.150120 Jul 15 20:49:41.040770 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 551/1100] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:49:40 2022] GET /compute/v2.1/servers/79357f76-766a-47c5-96e9-00d2aaebdad7 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:49:42.057932 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-e6d0eb68-c371-4548-ada8-6d6a4d1b4af6 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:49:42.058542 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-e6d0eb68-c371-4548-ada8-6d6a4d1b4af6 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] [instance: 79357f76-766a-47c5-96e9-00d2aaebdad7] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:49:42.060558 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell0:SELECT=2 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:49:42.061213 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell0:SELECT=6 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:49:42.067903 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e6d0eb68-c371-4548-ada8-6d6a4d1b4af6 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:49:42.068346 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e6d0eb68-c371-4548-ada8-6d6a4d1b4af6 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:49:42.069126 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e6d0eb68-c371-4548-ada8-6d6a4d1b4af6 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:49:42.069556 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e6d0eb68-c371-4548-ada8-6d6a4d1b4af6 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:49:42.203950 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-e6d0eb68-c371-4548-ada8-6d6a4d1b4af6 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5f88b90c3b43439d4f3f9b3dc63fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c09076eac534571bd221e2cc5872fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:49:42.211466 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-e6d0eb68-c371-4548-ada8-6d6a4d1b4af6 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] 10.222.0.66 "GET /compute/v2.1/servers/79357f76-766a-47c5-96e9-00d2aaebdad7" status: 200 len: 1265 microversion: 2.1 time: 0.157362 Jul 15 20:49:42.212021 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 550/1101] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:49:42 2022] GET /compute/v2.1/servers/79357f76-766a-47c5-96e9-00d2aaebdad7 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:49:43.230916 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-a82804a4-6992-414c-8eaa-faa4628101f0 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:49:43.231963 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-a82804a4-6992-414c-8eaa-faa4628101f0 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] [instance: 79357f76-766a-47c5-96e9-00d2aaebdad7] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:49:43.241370 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-a82804a4-6992-414c-8eaa-faa4628101f0 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:49:43.241825 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-a82804a4-6992-414c-8eaa-faa4628101f0 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:49:43.242602 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-a82804a4-6992-414c-8eaa-faa4628101f0 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:49:43.243041 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-a82804a4-6992-414c-8eaa-faa4628101f0 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:49:43.370989 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-a82804a4-6992-414c-8eaa-faa4628101f0 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5f88b90c3b43439d4f3f9b3dc63fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c09076eac534571bd221e2cc5872fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:49:43.379323 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-a82804a4-6992-414c-8eaa-faa4628101f0 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] 10.222.0.66 "GET /compute/v2.1/servers/79357f76-766a-47c5-96e9-00d2aaebdad7" status: 200 len: 1265 microversion: 2.1 time: 0.153249 Jul 15 20:49:43.379882 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 552/1102] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:49:43 2022] GET /compute/v2.1/servers/79357f76-766a-47c5-96e9-00d2aaebdad7 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:49:44.396751 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-fe7df71e-d179-4c87-9228-9440a9888290 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:49:44.397450 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-fe7df71e-d179-4c87-9228-9440a9888290 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] [instance: 79357f76-766a-47c5-96e9-00d2aaebdad7] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:49:44.403788 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fe7df71e-d179-4c87-9228-9440a9888290 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:49:44.404462 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fe7df71e-d179-4c87-9228-9440a9888290 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:49:44.405442 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fe7df71e-d179-4c87-9228-9440a9888290 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:49:44.405880 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fe7df71e-d179-4c87-9228-9440a9888290 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:49:44.478464 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [req-23b1ef71-5e33-4f59-96da-24096598825e req-10e4d2f5-c679-433c-99a7-d5f9e4146c8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79357f76-766a-47c5-96e9-00d2aaebdad7", "name": "network-vif-plugged", "status": "completed", "tag": "e574bcd1-198e-44c3-9af4-f6a527b99c75"}]} {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:49:44.487632 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-23b1ef71-5e33-4f59-96da-24096598825e req-10e4d2f5-c679-433c-99a7-d5f9e4146c8d service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:49:44.488076 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [req-23b1ef71-5e33-4f59-96da-24096598825e req-10e4d2f5-c679-433c-99a7-d5f9e4146c8d service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:49:44.498988 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.compute.server_external_events [req-23b1ef71-5e33-4f59-96da-24096598825e req-10e4d2f5-c679-433c-99a7-d5f9e4146c8d service nova] Creating event network-vif-plugged:e574bcd1-198e-44c3-9af4-f6a527b99c75 for instance 79357f76-766a-47c5-96e9-00d2aaebdad7 on hv-cinder-79987 Jul 15 20:49:44.504358 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [req-23b1ef71-5e33-4f59-96da-24096598825e req-10e4d2f5-c679-433c-99a7-d5f9e4146c8d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102023 Jul 15 20:49:44.504969 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 553/1103] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:49:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 20:49:44.551027 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-fe7df71e-d179-4c87-9228-9440a9888290 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5f88b90c3b43439d4f3f9b3dc63fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c09076eac534571bd221e2cc5872fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:49:44.558779 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-fe7df71e-d179-4c87-9228-9440a9888290 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] 10.222.0.66 "GET /compute/v2.1/servers/79357f76-766a-47c5-96e9-00d2aaebdad7" status: 200 len: 1265 microversion: 2.1 time: 0.167162 Jul 15 20:49:44.559337 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 551/1104] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:49:44 2022] GET /compute/v2.1/servers/79357f76-766a-47c5-96e9-00d2aaebdad7 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:49:45.575503 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-c2b206c0-30e8-4a0e-ae4e-963b36292257 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:49:45.576197 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-c2b206c0-30e8-4a0e-ae4e-963b36292257 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] [instance: 79357f76-766a-47c5-96e9-00d2aaebdad7] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:49:45.582595 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c2b206c0-30e8-4a0e-ae4e-963b36292257 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:49:45.583044 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c2b206c0-30e8-4a0e-ae4e-963b36292257 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:49:45.583799 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c2b206c0-30e8-4a0e-ae4e-963b36292257 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:49:45.584230 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-c2b206c0-30e8-4a0e-ae4e-963b36292257 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:49:45.957025 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-c2b206c0-30e8-4a0e-ae4e-963b36292257 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5f88b90c3b43439d4f3f9b3dc63fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c09076eac534571bd221e2cc5872fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:49:45.964383 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-c2b206c0-30e8-4a0e-ae4e-963b36292257 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] 10.222.0.66 "GET /compute/v2.1/servers/79357f76-766a-47c5-96e9-00d2aaebdad7" status: 200 len: 1265 microversion: 2.1 time: 0.393513 Jul 15 20:49:45.964969 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 554/1105] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:49:45 2022] GET /compute/v2.1/servers/79357f76-766a-47c5-96e9-00d2aaebdad7 => generated 1265 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:49:46.982150 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-89ab5da1-2d8b-44d5-8752-f1d1a6f2fba1 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:49:46.982749 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-89ab5da1-2d8b-44d5-8752-f1d1a6f2fba1 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] [instance: 79357f76-766a-47c5-96e9-00d2aaebdad7] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:49:46.989457 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-89ab5da1-2d8b-44d5-8752-f1d1a6f2fba1 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:49:46.989895 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-89ab5da1-2d8b-44d5-8752-f1d1a6f2fba1 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:49:46.990642 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-89ab5da1-2d8b-44d5-8752-f1d1a6f2fba1 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:49:46.991063 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-89ab5da1-2d8b-44d5-8752-f1d1a6f2fba1 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:49:47.118806 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-89ab5da1-2d8b-44d5-8752-f1d1a6f2fba1 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5f88b90c3b43439d4f3f9b3dc63fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c09076eac534571bd221e2cc5872fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:49:47.126339 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-89ab5da1-2d8b-44d5-8752-f1d1a6f2fba1 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] 10.222.0.66 "GET /compute/v2.1/servers/79357f76-766a-47c5-96e9-00d2aaebdad7" status: 200 len: 1452 microversion: 2.1 time: 0.148015 Jul 15 20:49:47.127716 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 552/1106] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:49:46 2022] GET /compute/v2.1/servers/79357f76-766a-47c5-96e9-00d2aaebdad7 => generated 1452 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:49:47.142780 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-e327e586-57d4-4895-9e63-fef988d9de3f tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:49:47.143376 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-e327e586-57d4-4895-9e63-fef988d9de3f tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] [instance: 79357f76-766a-47c5-96e9-00d2aaebdad7] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:49:47.149813 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e327e586-57d4-4895-9e63-fef988d9de3f tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:49:47.150289 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e327e586-57d4-4895-9e63-fef988d9de3f tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:49:47.151035 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e327e586-57d4-4895-9e63-fef988d9de3f tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:49:47.151467 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-e327e586-57d4-4895-9e63-fef988d9de3f tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:49:47.283131 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-e327e586-57d4-4895-9e63-fef988d9de3f tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5f88b90c3b43439d4f3f9b3dc63fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c09076eac534571bd221e2cc5872fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:49:47.290716 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-e327e586-57d4-4895-9e63-fef988d9de3f tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] 10.222.0.66 "GET /compute/v2.1/servers/79357f76-766a-47c5-96e9-00d2aaebdad7" status: 200 len: 1452 microversion: 2.1 time: 0.151742 Jul 15 20:49:47.291277 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 555/1107] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:49:47 2022] GET /compute/v2.1/servers/79357f76-766a-47c5-96e9-00d2aaebdad7 => generated 1452 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:49:49.094139 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-0da5f134-ec36-40a6-bd6c-8b3b3dc6811e req-afc3ecb2-7827-46ac-be5a-d9f915108846 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79357f76-766a-47c5-96e9-00d2aaebdad7", "tag": "e574bcd1-198e-44c3-9af4-f6a527b99c75"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:49:49.103197 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-0da5f134-ec36-40a6-bd6c-8b3b3dc6811e req-afc3ecb2-7827-46ac-be5a-d9f915108846 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:49:49.103636 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-0da5f134-ec36-40a6-bd6c-8b3b3dc6811e req-afc3ecb2-7827-46ac-be5a-d9f915108846 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:49:49.115380 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-0da5f134-ec36-40a6-bd6c-8b3b3dc6811e req-afc3ecb2-7827-46ac-be5a-d9f915108846 service nova] Creating event network-changed:e574bcd1-198e-44c3-9af4-f6a527b99c75 for instance 79357f76-766a-47c5-96e9-00d2aaebdad7 on hv-cinder-79987 Jul 15 20:49:49.120300 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-0da5f134-ec36-40a6-bd6c-8b3b3dc6811e req-afc3ecb2-7827-46ac-be5a-d9f915108846 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029779 Jul 15 20:49:49.121231 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 553/1108] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:49:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:51:17.519975 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_api:SELECT=22 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:51:17.521131 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG dbcounter [-] [124430] Writing DB stats nova_cell1:SELECT=50 {{(pid=124430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:51:17.523744 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:51:17.524753 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell1:SELECT=48 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 20:51:17.526535 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-b8e51585-5c4c-485e-bc7c-ff67440f232a tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:51:17.527166 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-b8e51585-5c4c-485e-bc7c-ff67440f232a tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] [instance: 79357f76-766a-47c5-96e9-00d2aaebdad7] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:51:17.530265 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-56697557-048b-406d-a23f-01c203f8087c req-b6c629bb-36c8-4a77-9cbe-bed3eedaf133 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79357f76-766a-47c5-96e9-00d2aaebdad7", "tag": "e574bcd1-198e-44c3-9af4-f6a527b99c75"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:51:17.534399 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b8e51585-5c4c-485e-bc7c-ff67440f232a tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:51:17.534846 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b8e51585-5c4c-485e-bc7c-ff67440f232a tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:51:17.535844 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b8e51585-5c4c-485e-bc7c-ff67440f232a tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:51:17.536282 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b8e51585-5c4c-485e-bc7c-ff67440f232a tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:51:17.539843 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-56697557-048b-406d-a23f-01c203f8087c req-b6c629bb-36c8-4a77-9cbe-bed3eedaf133 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:51:17.541422 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-56697557-048b-406d-a23f-01c203f8087c req-b6c629bb-36c8-4a77-9cbe-bed3eedaf133 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:51:17.553009 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-56697557-048b-406d-a23f-01c203f8087c req-b6c629bb-36c8-4a77-9cbe-bed3eedaf133 service nova] Creating event network-changed:e574bcd1-198e-44c3-9af4-f6a527b99c75 for instance 79357f76-766a-47c5-96e9-00d2aaebdad7 on hv-cinder-79987 Jul 15 20:51:17.558825 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-56697557-048b-406d-a23f-01c203f8087c req-b6c629bb-36c8-4a77-9cbe-bed3eedaf133 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036673 Jul 15 20:51:17.559757 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 554/1109] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:51:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:51:17.565446 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-b8e51585-5c4c-485e-bc7c-ff67440f232a tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] [instance: 79357f76-766a-47c5-96e9-00d2aaebdad7] Going to try to terminate instance {{(pid=124430) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 20:51:17.655194 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-b8e51585-5c4c-485e-bc7c-ff67440f232a tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] 10.222.0.66 "DELETE /compute/v2.1/servers/79357f76-766a-47c5-96e9-00d2aaebdad7" status: 204 len: 0 microversion: 2.1 time: 0.136899 Jul 15 20:51:17.658837 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 556/1110] 10.222.0.66 () {58 vars in 1238 bytes} [Fri Jul 15 20:51:17 2022] DELETE /compute/v2.1/servers/79357f76-766a-47c5-96e9-00d2aaebdad7 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 20:51:17.664612 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-cad33747-fc89-4f34-ad69-5dd348236b63 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:51:17.665329 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-cad33747-fc89-4f34-ad69-5dd348236b63 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] [instance: 79357f76-766a-47c5-96e9-00d2aaebdad7] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:51:17.672936 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-cad33747-fc89-4f34-ad69-5dd348236b63 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:51:17.673382 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-cad33747-fc89-4f34-ad69-5dd348236b63 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:51:17.674156 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-cad33747-fc89-4f34-ad69-5dd348236b63 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:51:17.674598 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-cad33747-fc89-4f34-ad69-5dd348236b63 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:51:17.819388 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-cad33747-fc89-4f34-ad69-5dd348236b63 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5f88b90c3b43439d4f3f9b3dc63fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c09076eac534571bd221e2cc5872fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:51:17.827622 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-cad33747-fc89-4f34-ad69-5dd348236b63 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] 10.222.0.66 "GET /compute/v2.1/servers/79357f76-766a-47c5-96e9-00d2aaebdad7" status: 200 len: 1577 microversion: 2.1 time: 0.167300 Jul 15 20:51:17.828195 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 555/1111] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:51:17 2022] GET /compute/v2.1/servers/79357f76-766a-47c5-96e9-00d2aaebdad7 => generated 1577 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:51:18.845363 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-b17358b6-333f-46e4-b3d3-5e41dec4a345 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:51:18.845968 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-b17358b6-333f-46e4-b3d3-5e41dec4a345 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] [instance: 79357f76-766a-47c5-96e9-00d2aaebdad7] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:51:18.852751 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b17358b6-333f-46e4-b3d3-5e41dec4a345 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:51:18.853204 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b17358b6-333f-46e4-b3d3-5e41dec4a345 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:51:18.853972 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b17358b6-333f-46e4-b3d3-5e41dec4a345 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:51:18.854407 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-b17358b6-333f-46e4-b3d3-5e41dec4a345 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:51:18.990048 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-b17358b6-333f-46e4-b3d3-5e41dec4a345 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5f88b90c3b43439d4f3f9b3dc63fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c09076eac534571bd221e2cc5872fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:51:18.997982 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-b17358b6-333f-46e4-b3d3-5e41dec4a345 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] 10.222.0.66 "GET /compute/v2.1/servers/79357f76-766a-47c5-96e9-00d2aaebdad7" status: 200 len: 1577 microversion: 2.1 time: 0.156955 Jul 15 20:51:18.998547 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 557/1112] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:51:18 2022] GET /compute/v2.1/servers/79357f76-766a-47c5-96e9-00d2aaebdad7 => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:51:19.860324 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-514ab98e-d516-4c8c-aca0-7dd2663144eb req-74d91c24-2598-409b-a5be-b4fb858fc9e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79357f76-766a-47c5-96e9-00d2aaebdad7", "name": "network-vif-deleted", "tag": "e574bcd1-198e-44c3-9af4-f6a527b99c75"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:51:19.869715 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-514ab98e-d516-4c8c-aca0-7dd2663144eb req-74d91c24-2598-409b-a5be-b4fb858fc9e2 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:51:19.870153 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-514ab98e-d516-4c8c-aca0-7dd2663144eb req-74d91c24-2598-409b-a5be-b4fb858fc9e2 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:51:19.882887 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-514ab98e-d516-4c8c-aca0-7dd2663144eb req-74d91c24-2598-409b-a5be-b4fb858fc9e2 service nova] Creating event network-vif-deleted:e574bcd1-198e-44c3-9af4-f6a527b99c75 for instance 79357f76-766a-47c5-96e9-00d2aaebdad7 on hv-cinder-79987 Jul 15 20:51:19.889341 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-514ab98e-d516-4c8c-aca0-7dd2663144eb req-74d91c24-2598-409b-a5be-b4fb858fc9e2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033178 Jul 15 20:51:19.889941 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 556/1113] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:51:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:51:20.015063 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-0e0b2663-6212-4520-a823-94576d86a12c tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:51:20.015664 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-0e0b2663-6212-4520-a823-94576d86a12c tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] [instance: 79357f76-766a-47c5-96e9-00d2aaebdad7] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:51:20.022080 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-0e0b2663-6212-4520-a823-94576d86a12c tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:51:20.022522 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-0e0b2663-6212-4520-a823-94576d86a12c tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:51:20.023268 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-0e0b2663-6212-4520-a823-94576d86a12c tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:51:20.023696 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-0e0b2663-6212-4520-a823-94576d86a12c tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:51:20.085783 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-0e0b2663-6212-4520-a823-94576d86a12c tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5f88b90c3b43439d4f3f9b3dc63fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c09076eac534571bd221e2cc5872fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:51:20.094074 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-0e0b2663-6212-4520-a823-94576d86a12c tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] 10.222.0.66 "GET /compute/v2.1/servers/79357f76-766a-47c5-96e9-00d2aaebdad7" status: 200 len: 1225 microversion: 2.1 time: 0.082932 Jul 15 20:51:20.094637 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 558/1114] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:51:20 2022] GET /compute/v2.1/servers/79357f76-766a-47c5-96e9-00d2aaebdad7 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:51:21.111314 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-a9a24b1d-9761-47e3-8185-88926d88e961 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:51:21.112031 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-a9a24b1d-9761-47e3-8185-88926d88e961 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] [instance: 79357f76-766a-47c5-96e9-00d2aaebdad7] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:51:21.118679 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a9a24b1d-9761-47e3-8185-88926d88e961 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:51:21.119119 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a9a24b1d-9761-47e3-8185-88926d88e961 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:51:21.119864 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a9a24b1d-9761-47e3-8185-88926d88e961 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:51:21.120289 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a9a24b1d-9761-47e3-8185-88926d88e961 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:51:21.133670 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.wsgi [None req-a9a24b1d-9761-47e3-8185-88926d88e961 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] HTTP exception thrown: Instance 79357f76-766a-47c5-96e9-00d2aaebdad7 could not be found. Jul 15 20:51:21.135254 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-a9a24b1d-9761-47e3-8185-88926d88e961 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Request method failure captured: Jul 15 20:51:21.135254 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: request: GET /compute/v2.1/servers/79357f76-766a-47c5-96e9-00d2aaebdad7 HTTP/1.1 Jul 15 20:51:21.135254 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Accept: application/json Jul 15 20:51:21.135254 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Accept-Encoding: identity Jul 15 20:51:21.135254 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Connection: close Jul 15 20:51:21.135254 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Content-Length: 0 Jul 15 20:51:21.135254 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Content-Type: application/json Jul 15 20:51:21.135254 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Host: 10.222.0.66 Jul 15 20:51:21.135254 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Openstack-System-Scope: None Jul 15 20:51:21.135254 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: User-Agent: python-urllib3/1.26.9 Jul 15 20:51:21.135254 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Auth-Token: gAAAAABi0dGy1WB24Z1i5jX6X1HxARoDl7WKJyZLHo6VEk0CASphFJOYTal-MKxbQQSA5d4_fUbjf24G_rbW7I66I0PKEopM8NrzY42NGeGQNDsfK2Z7xbbMX7XHzWdwdDRK-FU34AuWXDvYeMFPdBw19kjqDkRjjnmZdVXJ6ckysMa05KMkDp8 Jul 15 20:51:21.135254 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Domain-Id: None Jul 15 20:51:21.135254 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Domain-Name: None Jul 15 20:51:21.135254 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Identity-Status: Confirmed Jul 15 20:51:21.135254 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Is-Admin-Project: True Jul 15 20:51:21.135254 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Domain-Id: default Jul 15 20:51:21.135254 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Domain-Name: Default Jul 15 20:51:21.135254 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Id: 6c09076eac534571bd221e2cc5872fc6 Jul 15 20:51:21.135254 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Name: tempest-TestVolumeBootPattern-1326544490 Jul 15 20:51:21.135254 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Role: member,reader Jul 15 20:51:21.135254 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Roles: member,reader Jul 15 20:51:21.137702 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6c09076eac534571bd221e2cc5872fc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_6c09076eac534571bd221e2cc5872fc6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6c09076eac534571bd221e2cc5872fc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/6c09076eac534571bd221e2cc5872fc6"}]}] Jul 15 20:51:21.137702 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Tenant: tempest-TestVolumeBootPattern-1326544490 Jul 15 20:51:21.137702 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Tenant-Id: 6c09076eac534571bd221e2cc5872fc6 Jul 15 20:51:21.137702 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Tenant-Name: tempest-TestVolumeBootPattern-1326544490 Jul 15 20:51:21.137702 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User: tempest-TestVolumeBootPattern-1326544490-project Jul 15 20:51:21.137702 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Domain-Id: default Jul 15 20:51:21.137702 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Domain-Name: Default Jul 15 20:51:21.137702 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Id: ce5f88b90c3b43439d4f3f9b3dc63fff Jul 15 20:51:21.137702 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Name: tempest-TestVolumeBootPattern-1326544490-project Jul 15 20:51:21.137702 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: method: > Jul 15 20:51:21.137702 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: exception: Instance 79357f76-766a-47c5-96e9-00d2aaebdad7 could not be found. Jul 15 20:51:21.137702 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: action_args: {'id': '79357f76-766a-47c5-96e9-00d2aaebdad7'} Jul 15 20:51:21.138575 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 20:51:21.138575 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:51:21.138575 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 20:51:21.138575 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 20:51:21.138575 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 20:51:21.138575 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 20:51:21.138575 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 20:51:21.138575 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 20:51:21.138575 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 20:51:21.138575 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 20:51:21.138575 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79357f76-766a-47c5-96e9-00d2aaebdad7 could not be found. Jul 15 20:51:21.138575 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:51:21.138575 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:51:21.138575 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:51:21.138575 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:51:21.138575 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:51:21.138575 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:51:21.138575 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 20:51:21.138575 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 20:51:21.138575 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 20:51:21.140282 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 20:51:21.140282 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 20:51:21.140282 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 20:51:21.140282 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 20:51:21.140282 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 20:51:21.140282 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 20:51:21.140282 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 20:51:21.140282 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79357f76-766a-47c5-96e9-00d2aaebdad7 could not be found. Jul 15 20:51:21.140282 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:51:21.140282 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:51:21.140282 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:51:21.140282 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:51:21.140282 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:51:21.140282 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:51:21.140282 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 20:51:21.140282 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 20:51:21.140282 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79357f76-766a-47c5-96e9-00d2aaebdad7 could not be found. Jul 15 20:51:21.140282 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:51:21.141825 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-a9a24b1d-9761-47e3-8185-88926d88e961 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Returning 404 to user: Instance 79357f76-766a-47c5-96e9-00d2aaebdad7 could not be found. {{(pid=124432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 20:51:21.141825 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-a9a24b1d-9761-47e3-8185-88926d88e961 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] 10.222.0.66 "GET /compute/v2.1/servers/79357f76-766a-47c5-96e9-00d2aaebdad7" status: 404 len: 111 microversion: 2.1 time: 0.029474 Jul 15 20:51:21.141825 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 557/1115] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:51:21 2022] GET /compute/v2.1/servers/79357f76-766a-47c5-96e9-00d2aaebdad7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 20:51:24.192646 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-a49b9088-0f24-4bb4-b60b-bee92aa540d2 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:51:24.193133 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-a49b9088-0f24-4bb4-b60b-bee92aa540d2 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] [instance: 9293b8fc-2bf0-481f-ac99-e06e586fcb5d] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:51:24.194787 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-5c81e646-106f-4681-8a3c-4d7cf2f313b0 req-f2b4da02-97e8-4bb9-bc41-cac766406eb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9293b8fc-2bf0-481f-ac99-e06e586fcb5d", "tag": "f2037b81-737e-4a90-bc77-00e0442b9d7a"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:51:24.200274 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-a49b9088-0f24-4bb4-b60b-bee92aa540d2 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:51:24.200837 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-a49b9088-0f24-4bb4-b60b-bee92aa540d2 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:51:24.201682 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-a49b9088-0f24-4bb4-b60b-bee92aa540d2 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:51:24.202183 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-a49b9088-0f24-4bb4-b60b-bee92aa540d2 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:51:24.205074 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-5c81e646-106f-4681-8a3c-4d7cf2f313b0 req-f2b4da02-97e8-4bb9-bc41-cac766406eb0 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:51:24.205510 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-5c81e646-106f-4681-8a3c-4d7cf2f313b0 req-f2b4da02-97e8-4bb9-bc41-cac766406eb0 service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:51:24.218343 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-5c81e646-106f-4681-8a3c-4d7cf2f313b0 req-f2b4da02-97e8-4bb9-bc41-cac766406eb0 service nova] Creating event network-changed:f2037b81-737e-4a90-bc77-00e0442b9d7a for instance 9293b8fc-2bf0-481f-ac99-e06e586fcb5d on hv-cinder-79987 Jul 15 20:51:24.224055 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-5c81e646-106f-4681-8a3c-4d7cf2f313b0 req-f2b4da02-97e8-4bb9-bc41-cac766406eb0 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032829 Jul 15 20:51:24.225002 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 558/1116] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:51:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:51:24.232475 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-a49b9088-0f24-4bb4-b60b-bee92aa540d2 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] [instance: 9293b8fc-2bf0-481f-ac99-e06e586fcb5d] Going to try to terminate instance {{(pid=124430) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 20:51:24.327736 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-a49b9088-0f24-4bb4-b60b-bee92aa540d2 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] 10.222.0.66 "DELETE /compute/v2.1/servers/9293b8fc-2bf0-481f-ac99-e06e586fcb5d" status: 204 len: 0 microversion: 2.1 time: 0.138931 Jul 15 20:51:24.328684 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 559/1117] 10.222.0.66 () {58 vars in 1238 bytes} [Fri Jul 15 20:51:24 2022] DELETE /compute/v2.1/servers/9293b8fc-2bf0-481f-ac99-e06e586fcb5d => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 20:51:24.338305 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-d6979cc0-9aaa-4e6b-b8b6-c7feb2e45758 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:51:24.340311 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-d6979cc0-9aaa-4e6b-b8b6-c7feb2e45758 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] [instance: 9293b8fc-2bf0-481f-ac99-e06e586fcb5d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:51:24.350602 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d6979cc0-9aaa-4e6b-b8b6-c7feb2e45758 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:51:24.351507 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d6979cc0-9aaa-4e6b-b8b6-c7feb2e45758 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:51:24.352519 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d6979cc0-9aaa-4e6b-b8b6-c7feb2e45758 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:51:24.353163 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d6979cc0-9aaa-4e6b-b8b6-c7feb2e45758 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:51:24.492621 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-d6979cc0-9aaa-4e6b-b8b6-c7feb2e45758 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5f88b90c3b43439d4f3f9b3dc63fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c09076eac534571bd221e2cc5872fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:51:24.500229 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-d6979cc0-9aaa-4e6b-b8b6-c7feb2e45758 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] 10.222.0.66 "GET /compute/v2.1/servers/9293b8fc-2bf0-481f-ac99-e06e586fcb5d" status: 200 len: 1577 microversion: 2.1 time: 0.167040 Jul 15 20:51:24.500924 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 559/1118] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:51:24 2022] GET /compute/v2.1/servers/9293b8fc-2bf0-481f-ac99-e06e586fcb5d => generated 1577 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 20:51:25.518844 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-4dec5c7b-6e6a-4cde-8789-e71c3ab69f39 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:51:25.519535 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-4dec5c7b-6e6a-4cde-8789-e71c3ab69f39 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] [instance: 9293b8fc-2bf0-481f-ac99-e06e586fcb5d] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:51:25.526064 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-4dec5c7b-6e6a-4cde-8789-e71c3ab69f39 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:51:25.526506 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-4dec5c7b-6e6a-4cde-8789-e71c3ab69f39 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:51:25.527938 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-4dec5c7b-6e6a-4cde-8789-e71c3ab69f39 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:51:25.528431 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-4dec5c7b-6e6a-4cde-8789-e71c3ab69f39 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:51:25.663866 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-4dec5c7b-6e6a-4cde-8789-e71c3ab69f39 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5f88b90c3b43439d4f3f9b3dc63fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c09076eac534571bd221e2cc5872fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:51:25.671573 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-4dec5c7b-6e6a-4cde-8789-e71c3ab69f39 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] 10.222.0.66 "GET /compute/v2.1/servers/9293b8fc-2bf0-481f-ac99-e06e586fcb5d" status: 200 len: 1577 microversion: 2.1 time: 0.157002 Jul 15 20:51:25.672427 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 560/1119] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:51:25 2022] GET /compute/v2.1/servers/9293b8fc-2bf0-481f-ac99-e06e586fcb5d => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:51:26.481072 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-32a1fe2b-f99e-4a66-b658-b6ffcf79e548 req-39bba16b-4487-4643-a2b3-380b0a899f3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9293b8fc-2bf0-481f-ac99-e06e586fcb5d", "name": "network-vif-deleted", "tag": "f2037b81-737e-4a90-bc77-00e0442b9d7a"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 20:51:26.489600 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-32a1fe2b-f99e-4a66-b658-b6ffcf79e548 req-39bba16b-4487-4643-a2b3-380b0a899f3a service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:51:26.490043 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-32a1fe2b-f99e-4a66-b658-b6ffcf79e548 req-39bba16b-4487-4643-a2b3-380b0a899f3a service nova] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:51:26.502064 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-32a1fe2b-f99e-4a66-b658-b6ffcf79e548 req-39bba16b-4487-4643-a2b3-380b0a899f3a service nova] Creating event network-vif-deleted:f2037b81-737e-4a90-bc77-00e0442b9d7a for instance 9293b8fc-2bf0-481f-ac99-e06e586fcb5d on hv-cinder-79987 Jul 15 20:51:26.507045 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-32a1fe2b-f99e-4a66-b658-b6ffcf79e548 req-39bba16b-4487-4643-a2b3-380b0a899f3a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029659 Jul 15 20:51:26.507654 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 560/1120] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 15 20:51:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 20:51:26.689857 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-9c854340-0c26-470a-b115-c0eecc4fba3e tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:51:26.690467 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-9c854340-0c26-470a-b115-c0eecc4fba3e tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] [instance: 9293b8fc-2bf0-481f-ac99-e06e586fcb5d] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:51:26.696981 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-9c854340-0c26-470a-b115-c0eecc4fba3e tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:51:26.697382 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-9c854340-0c26-470a-b115-c0eecc4fba3e tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:51:26.698152 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-9c854340-0c26-470a-b115-c0eecc4fba3e tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:51:26.698587 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-9c854340-0c26-470a-b115-c0eecc4fba3e tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:51:26.763251 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.policy [None req-9c854340-0c26-470a-b115-c0eecc4fba3e tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5f88b90c3b43439d4f3f9b3dc63fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c09076eac534571bd221e2cc5872fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124430) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 20:51:26.771335 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-9c854340-0c26-470a-b115-c0eecc4fba3e tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] 10.222.0.66 "GET /compute/v2.1/servers/9293b8fc-2bf0-481f-ac99-e06e586fcb5d" status: 200 len: 1225 microversion: 2.1 time: 0.085332 Jul 15 20:51:26.771905 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 561/1121] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:51:26 2022] GET /compute/v2.1/servers/9293b8fc-2bf0-481f-ac99-e06e586fcb5d => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 20:51:27.788347 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-f6d38dfb-3f4e-4292-abcd-97314b20800f tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:51:27.789000 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-f6d38dfb-3f4e-4292-abcd-97314b20800f tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] [instance: 9293b8fc-2bf0-481f-ac99-e06e586fcb5d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:51:27.795569 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f6d38dfb-3f4e-4292-abcd-97314b20800f tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:51:27.796024 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f6d38dfb-3f4e-4292-abcd-97314b20800f tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:51:27.796796 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f6d38dfb-3f4e-4292-abcd-97314b20800f tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:51:27.797482 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f6d38dfb-3f4e-4292-abcd-97314b20800f tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:51:27.812120 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.wsgi [None req-f6d38dfb-3f4e-4292-abcd-97314b20800f tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] HTTP exception thrown: Instance 9293b8fc-2bf0-481f-ac99-e06e586fcb5d could not be found. Jul 15 20:51:27.813734 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-f6d38dfb-3f4e-4292-abcd-97314b20800f tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Request method failure captured: Jul 15 20:51:27.813734 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: request: GET /compute/v2.1/servers/9293b8fc-2bf0-481f-ac99-e06e586fcb5d HTTP/1.1 Jul 15 20:51:27.813734 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Accept: application/json Jul 15 20:51:27.813734 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Accept-Encoding: identity Jul 15 20:51:27.813734 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Connection: close Jul 15 20:51:27.813734 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Content-Length: 0 Jul 15 20:51:27.813734 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Content-Type: application/json Jul 15 20:51:27.813734 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Host: 10.222.0.66 Jul 15 20:51:27.813734 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Openstack-System-Scope: None Jul 15 20:51:27.813734 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: User-Agent: python-urllib3/1.26.9 Jul 15 20:51:27.813734 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Auth-Token: gAAAAABi0dGy1WB24Z1i5jX6X1HxARoDl7WKJyZLHo6VEk0CASphFJOYTal-MKxbQQSA5d4_fUbjf24G_rbW7I66I0PKEopM8NrzY42NGeGQNDsfK2Z7xbbMX7XHzWdwdDRK-FU34AuWXDvYeMFPdBw19kjqDkRjjnmZdVXJ6ckysMa05KMkDp8 Jul 15 20:51:27.813734 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Domain-Id: None Jul 15 20:51:27.813734 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Domain-Name: None Jul 15 20:51:27.813734 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Identity-Status: Confirmed Jul 15 20:51:27.813734 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Is-Admin-Project: True Jul 15 20:51:27.813734 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Domain-Id: default Jul 15 20:51:27.813734 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Domain-Name: Default Jul 15 20:51:27.813734 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Id: 6c09076eac534571bd221e2cc5872fc6 Jul 15 20:51:27.813734 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Name: tempest-TestVolumeBootPattern-1326544490 Jul 15 20:51:27.813734 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Role: member,reader Jul 15 20:51:27.813734 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Roles: member,reader Jul 15 20:51:27.815378 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6c09076eac534571bd221e2cc5872fc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_6c09076eac534571bd221e2cc5872fc6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6c09076eac534571bd221e2cc5872fc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/6c09076eac534571bd221e2cc5872fc6"}]}] Jul 15 20:51:27.815378 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Tenant: tempest-TestVolumeBootPattern-1326544490 Jul 15 20:51:27.815378 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Tenant-Id: 6c09076eac534571bd221e2cc5872fc6 Jul 15 20:51:27.815378 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Tenant-Name: tempest-TestVolumeBootPattern-1326544490 Jul 15 20:51:27.815378 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User: tempest-TestVolumeBootPattern-1326544490-project Jul 15 20:51:27.815378 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Domain-Id: default Jul 15 20:51:27.815378 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Domain-Name: Default Jul 15 20:51:27.815378 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Id: ce5f88b90c3b43439d4f3f9b3dc63fff Jul 15 20:51:27.815378 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Name: tempest-TestVolumeBootPattern-1326544490-project Jul 15 20:51:27.815378 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: method: > Jul 15 20:51:27.815378 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: exception: Instance 9293b8fc-2bf0-481f-ac99-e06e586fcb5d could not be found. Jul 15 20:51:27.815378 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: action_args: {'id': '9293b8fc-2bf0-481f-ac99-e06e586fcb5d'} Jul 15 20:51:27.816250 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 20:51:27.816250 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:51:27.816250 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 20:51:27.816250 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 20:51:27.816250 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 20:51:27.816250 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 20:51:27.816250 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 20:51:27.816250 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 20:51:27.816250 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 20:51:27.816250 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 20:51:27.816250 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9293b8fc-2bf0-481f-ac99-e06e586fcb5d could not be found. Jul 15 20:51:27.816250 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:51:27.816250 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:51:27.816250 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:51:27.816250 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:51:27.816250 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:51:27.816250 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:51:27.816250 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 20:51:27.816250 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 20:51:27.816250 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 20:51:27.818537 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 20:51:27.818537 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 20:51:27.818537 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 20:51:27.818537 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 20:51:27.818537 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 20:51:27.818537 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 20:51:27.818537 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 20:51:27.818537 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9293b8fc-2bf0-481f-ac99-e06e586fcb5d could not be found. Jul 15 20:51:27.818537 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:51:27.818537 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:51:27.818537 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:51:27.818537 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:51:27.818537 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:51:27.818537 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:51:27.818537 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 20:51:27.818537 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 20:51:27.818537 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9293b8fc-2bf0-481f-ac99-e06e586fcb5d could not be found. Jul 15 20:51:27.818537 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:51:27.821048 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-f6d38dfb-3f4e-4292-abcd-97314b20800f tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Returning 404 to user: Instance 9293b8fc-2bf0-481f-ac99-e06e586fcb5d could not be found. {{(pid=124432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 20:51:27.821048 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-f6d38dfb-3f4e-4292-abcd-97314b20800f tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] 10.222.0.66 "GET /compute/v2.1/servers/9293b8fc-2bf0-481f-ac99-e06e586fcb5d" status: 404 len: 111 microversion: 2.1 time: 0.031691 Jul 15 20:51:27.821048 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 561/1122] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:51:27 2022] GET /compute/v2.1/servers/9293b8fc-2bf0-481f-ac99-e06e586fcb5d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 20:51:28.252193 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-94b40375-64db-4b99-bb24-fce861ceca70 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Calling method '>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:51:28.252731 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.compute.api [None req-94b40375-64db-4b99-bb24-fce861ceca70 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] [instance: 2285aca5-babb-4433-9939-b29a56721716] Fetching instance by UUID {{(pid=124430) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:51:28.259200 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-94b40375-64db-4b99-bb24-fce861ceca70 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:51:28.259644 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-94b40375-64db-4b99-bb24-fce861ceca70 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:51:28.260412 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-94b40375-64db-4b99-bb24-fce861ceca70 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:51:28.260851 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG oslo_concurrency.lockutils [None req-94b40375-64db-4b99-bb24-fce861ceca70 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:51:28.273665 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.wsgi [None req-94b40375-64db-4b99-bb24-fce861ceca70 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] HTTP exception thrown: Instance 2285aca5-babb-4433-9939-b29a56721716 could not be found. Jul 15 20:51:28.275276 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-94b40375-64db-4b99-bb24-fce861ceca70 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Request method failure captured: Jul 15 20:51:28.275276 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: request: DELETE /compute/v2.1/servers/2285aca5-babb-4433-9939-b29a56721716 HTTP/1.1 Jul 15 20:51:28.275276 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Accept: application/json Jul 15 20:51:28.275276 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Accept-Encoding: identity Jul 15 20:51:28.275276 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Connection: close Jul 15 20:51:28.275276 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Content-Length: 0 Jul 15 20:51:28.275276 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Content-Type: application/json Jul 15 20:51:28.275276 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Host: 10.222.0.66 Jul 15 20:51:28.275276 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Openstack-System-Scope: None Jul 15 20:51:28.275276 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: User-Agent: python-urllib3/1.26.9 Jul 15 20:51:28.275276 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Auth-Token: gAAAAABi0dGy1WB24Z1i5jX6X1HxARoDl7WKJyZLHo6VEk0CASphFJOYTal-MKxbQQSA5d4_fUbjf24G_rbW7I66I0PKEopM8NrzY42NGeGQNDsfK2Z7xbbMX7XHzWdwdDRK-FU34AuWXDvYeMFPdBw19kjqDkRjjnmZdVXJ6ckysMa05KMkDp8 Jul 15 20:51:28.275276 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Domain-Id: None Jul 15 20:51:28.275276 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Domain-Name: None Jul 15 20:51:28.275276 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Identity-Status: Confirmed Jul 15 20:51:28.275276 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Is-Admin-Project: True Jul 15 20:51:28.275276 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Domain-Id: default Jul 15 20:51:28.275276 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Domain-Name: Default Jul 15 20:51:28.275276 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Id: 6c09076eac534571bd221e2cc5872fc6 Jul 15 20:51:28.275276 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Project-Name: tempest-TestVolumeBootPattern-1326544490 Jul 15 20:51:28.275276 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Role: member,reader Jul 15 20:51:28.275276 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Roles: member,reader Jul 15 20:51:28.277636 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6c09076eac534571bd221e2cc5872fc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_6c09076eac534571bd221e2cc5872fc6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6c09076eac534571bd221e2cc5872fc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/6c09076eac534571bd221e2cc5872fc6"}]}] Jul 15 20:51:28.277636 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant: tempest-TestVolumeBootPattern-1326544490 Jul 15 20:51:28.277636 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant-Id: 6c09076eac534571bd221e2cc5872fc6 Jul 15 20:51:28.277636 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-Tenant-Name: tempest-TestVolumeBootPattern-1326544490 Jul 15 20:51:28.277636 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User: tempest-TestVolumeBootPattern-1326544490-project Jul 15 20:51:28.277636 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Domain-Id: default Jul 15 20:51:28.277636 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Domain-Name: Default Jul 15 20:51:28.277636 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Id: ce5f88b90c3b43439d4f3f9b3dc63fff Jul 15 20:51:28.277636 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: X-User-Name: tempest-TestVolumeBootPattern-1326544490-project Jul 15 20:51:28.277636 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: method: > Jul 15 20:51:28.277636 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: exception: Instance 2285aca5-babb-4433-9939-b29a56721716 could not be found. Jul 15 20:51:28.277636 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: action_args: {'id': '2285aca5-babb-4433-9939-b29a56721716'} Jul 15 20:51:28.278697 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 20:51:28.278697 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:51:28.278697 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 20:51:28.278697 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 20:51:28.278697 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 20:51:28.278697 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 20:51:28.278697 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 20:51:28.278697 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 20:51:28.278697 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 20:51:28.278697 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 20:51:28.278697 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2285aca5-babb-4433-9939-b29a56721716 could not be found. Jul 15 20:51:28.278697 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:51:28.278697 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:51:28.278697 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:51:28.278697 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:51:28.278697 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:51:28.278697 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:51:28.278697 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 20:51:28.278697 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 20:51:28.278697 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 20:51:28.280326 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 20:51:28.280326 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 15 20:51:28.280326 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 15 20:51:28.280326 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 15 20:51:28.280326 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 15 20:51:28.280326 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 20:51:28.280326 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 20:51:28.280326 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 20:51:28.280326 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 20:51:28.280326 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2285aca5-babb-4433-9939-b29a56721716 could not be found. Jul 15 20:51:28.280326 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:51:28.280326 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:51:28.280326 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:51:28.280326 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:51:28.280326 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:51:28.280326 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:51:28.280326 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 20:51:28.280326 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 20:51:28.280326 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2285aca5-babb-4433-9939-b29a56721716 could not be found. Jul 15 20:51:28.280326 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: ERROR nova.api.openstack.wsgi Jul 15 20:51:28.282095 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-94b40375-64db-4b99-bb24-fce861ceca70 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Returning 404 to user: Instance 2285aca5-babb-4433-9939-b29a56721716 could not be found. {{(pid=124430) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 20:51:28.282095 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-94b40375-64db-4b99-bb24-fce861ceca70 tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] 10.222.0.66 "DELETE /compute/v2.1/servers/2285aca5-babb-4433-9939-b29a56721716" status: 404 len: 111 microversion: 2.1 time: 0.028275 Jul 15 20:51:28.282095 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 562/1123] 10.222.0.66 () {58 vars in 1238 bytes} [Fri Jul 15 20:51:28 2022] DELETE /compute/v2.1/servers/2285aca5-babb-4433-9939-b29a56721716 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 20:51:28.285799 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-56edc16b-844e-4b6e-b905-45eca32d16dd tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:51:28.286400 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-56edc16b-844e-4b6e-b905-45eca32d16dd tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] [instance: 2285aca5-babb-4433-9939-b29a56721716] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 20:51:28.292295 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-56edc16b-844e-4b6e-b905-45eca32d16dd tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:51:28.293553 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-56edc16b-844e-4b6e-b905-45eca32d16dd tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:51:28.294303 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-56edc16b-844e-4b6e-b905-45eca32d16dd tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 20:51:28.294729 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-56edc16b-844e-4b6e-b905-45eca32d16dd tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Lock "5eaba057-d4d0-4606-828e-5e21cf3c2999" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 20:51:28.308021 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.wsgi [None req-56edc16b-844e-4b6e-b905-45eca32d16dd tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] HTTP exception thrown: Instance 2285aca5-babb-4433-9939-b29a56721716 could not be found. Jul 15 20:51:28.309631 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-56edc16b-844e-4b6e-b905-45eca32d16dd tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Request method failure captured: Jul 15 20:51:28.309631 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: request: GET /compute/v2.1/servers/2285aca5-babb-4433-9939-b29a56721716 HTTP/1.1 Jul 15 20:51:28.309631 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Accept: application/json Jul 15 20:51:28.309631 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Accept-Encoding: identity Jul 15 20:51:28.309631 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Connection: close Jul 15 20:51:28.309631 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Content-Length: 0 Jul 15 20:51:28.309631 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Content-Type: application/json Jul 15 20:51:28.309631 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Host: 10.222.0.66 Jul 15 20:51:28.309631 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Openstack-System-Scope: None Jul 15 20:51:28.309631 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: User-Agent: python-urllib3/1.26.9 Jul 15 20:51:28.309631 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Auth-Token: gAAAAABi0dGy1WB24Z1i5jX6X1HxARoDl7WKJyZLHo6VEk0CASphFJOYTal-MKxbQQSA5d4_fUbjf24G_rbW7I66I0PKEopM8NrzY42NGeGQNDsfK2Z7xbbMX7XHzWdwdDRK-FU34AuWXDvYeMFPdBw19kjqDkRjjnmZdVXJ6ckysMa05KMkDp8 Jul 15 20:51:28.309631 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Domain-Id: None Jul 15 20:51:28.309631 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Domain-Name: None Jul 15 20:51:28.309631 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Identity-Status: Confirmed Jul 15 20:51:28.309631 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Is-Admin-Project: True Jul 15 20:51:28.309631 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Domain-Id: default Jul 15 20:51:28.309631 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Domain-Name: Default Jul 15 20:51:28.309631 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Id: 6c09076eac534571bd221e2cc5872fc6 Jul 15 20:51:28.309631 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Project-Name: tempest-TestVolumeBootPattern-1326544490 Jul 15 20:51:28.309631 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Role: member,reader Jul 15 20:51:28.309631 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Roles: member,reader Jul 15 20:51:28.311349 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6c09076eac534571bd221e2cc5872fc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_6c09076eac534571bd221e2cc5872fc6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6c09076eac534571bd221e2cc5872fc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/6c09076eac534571bd221e2cc5872fc6"}]}] Jul 15 20:51:28.311349 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Tenant: tempest-TestVolumeBootPattern-1326544490 Jul 15 20:51:28.311349 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Tenant-Id: 6c09076eac534571bd221e2cc5872fc6 Jul 15 20:51:28.311349 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-Tenant-Name: tempest-TestVolumeBootPattern-1326544490 Jul 15 20:51:28.311349 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User: tempest-TestVolumeBootPattern-1326544490-project Jul 15 20:51:28.311349 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Domain-Id: default Jul 15 20:51:28.311349 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Domain-Name: Default Jul 15 20:51:28.311349 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Id: ce5f88b90c3b43439d4f3f9b3dc63fff Jul 15 20:51:28.311349 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: X-User-Name: tempest-TestVolumeBootPattern-1326544490-project Jul 15 20:51:28.311349 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: method: > Jul 15 20:51:28.311349 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: exception: Instance 2285aca5-babb-4433-9939-b29a56721716 could not be found. Jul 15 20:51:28.311349 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: action_args: {'id': '2285aca5-babb-4433-9939-b29a56721716'} Jul 15 20:51:28.312311 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 20:51:28.312311 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:51:28.312311 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 20:51:28.312311 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 20:51:28.312311 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 20:51:28.312311 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 20:51:28.312311 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 20:51:28.312311 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 20:51:28.312311 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 20:51:28.312311 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 20:51:28.312311 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2285aca5-babb-4433-9939-b29a56721716 could not be found. Jul 15 20:51:28.312311 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:51:28.312311 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:51:28.312311 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:51:28.312311 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:51:28.312311 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:51:28.312311 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:51:28.312311 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 20:51:28.312311 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 20:51:28.312311 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 20:51:28.313936 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 20:51:28.313936 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 20:51:28.313936 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 20:51:28.313936 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 20:51:28.313936 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 20:51:28.313936 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 20:51:28.313936 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 20:51:28.313936 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2285aca5-babb-4433-9939-b29a56721716 could not be found. Jul 15 20:51:28.313936 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:51:28.313936 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 20:51:28.313936 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:51:28.313936 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 20:51:28.313936 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 20:51:28.313936 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 20:51:28.313936 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 20:51:28.313936 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 20:51:28.313936 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2285aca5-babb-4433-9939-b29a56721716 could not be found. Jul 15 20:51:28.313936 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Jul 15 20:51:28.315593 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-56edc16b-844e-4b6e-b905-45eca32d16dd tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Returning 404 to user: Instance 2285aca5-babb-4433-9939-b29a56721716 could not be found. {{(pid=124432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 20:51:28.315593 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-56edc16b-844e-4b6e-b905-45eca32d16dd tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] 10.222.0.66 "GET /compute/v2.1/servers/2285aca5-babb-4433-9939-b29a56721716" status: 404 len: 111 microversion: 2.1 time: 0.028937 Jul 15 20:51:28.315593 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 562/1124] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 15 20:51:28 2022] GET /compute/v2.1/servers/2285aca5-babb-4433-9939-b29a56721716 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 20:51:29.607955 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: DEBUG nova.api.openstack.wsgi [None req-b52aa3ef-b9f7-4e7c-b8c4-7eddd4e2510c tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] Calling method '.version_select at 0x7ff5182db280>' {{(pid=124430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 20:51:29.630779 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO nova.api.openstack.requestlog [None req-b52aa3ef-b9f7-4e7c-b8c4-7eddd4e2510c tempest-TestVolumeBootPattern-1326544490 tempest-TestVolumeBootPattern-1326544490-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2104996658" status: 202 len: 0 microversion: 2.1 time: 0.027323 Jul 15 20:51:29.631356 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: [pid: 124430|app: 0|req: 563/1125] 10.222.0.66 () {58 vars in 1262 bytes} [Fri Jul 15 20:51:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2104996658 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 20:51:56.697851 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 15 20:51:56.698457 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Fri Jul 15 20:51:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 15 20:51:59.069665 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 15 20:51:59.070308 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Fri Jul 15 20:51:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 15 20:53:29.235784 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 15 20:53:29.236446 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Fri Jul 15 20:53:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 15 20:53:33.581856 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 15 20:53:33.582624 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Fri Jul 15 20:53:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 15 20:55:16.707409 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 15 20:55:16.707930 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Fri Jul 15 20:55:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 15 20:55:19.077899 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 15 20:55:19.078425 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Fri Jul 15 20:55:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 15 20:56:49.244054 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 15 20:56:49.244709 dv-cinder-799871-35-iscsi devstack@n-api.service[124432]: Fri Jul 15 20:56:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 15 20:56:53.589841 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 15 20:56:53.590346 dv-cinder-799871-35-iscsi devstack@n-api.service[124430]: Fri Jul 15 20:56:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!